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AESTSICT 

• ' The Assessment and eraluation programs of Colorado, 

Connecticut, Florida, and Bichigan, and the derelopment and 
implementation of steps they initiated to progress toward the goal' of 
accountability are described in. detail in this report. Following the 
introduction, section 2 discusses the law5 enaqted by the four states 
that are the basis for their programs and gires an ex|)lanation of the 
background of the legislation and the. content of the statutes. 
Section 3 demonstrates how the laws are being put into action by each 
of the states and the changes in policy and strategy that took place 
since they were enacted. SeversTl tables compare how the .states are 
implementing their programs. Some of the technical, communicative, * 
and political problems are described in section 4. Two appendixes 
complete the report: a© annotated reference list of state agency 
reports and other materials, and copies of the state laws that are 
coTered. (Author/HLF) 
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. Expanding, nationwide interest and^tivity in the area of educational accountability naturally has brought a 
corresponding demand for informatKTn concerning the various aspects of existing'accountabiiity program^ More 
and more, departments of education, legislators, teachers, and citizens ask, "What are other states doing about 
accountability and how^re they doing it?" 

If time and finances permitted, each inquirer could embark upon a lengthy journey to find out, firsthand, what^ 
-IS happening in other states. Or they-cp«irhSy^k out the hundfeds of doc-umepi^ fr om %hK)h m4ght be^ieced* 
together various state accountabilit>^^ries. Happily, the authors of this mOp<jgraph have simplified the task by 
providing a careful overview of account$bility efforts in four representajiyestates; thus a single publication may 
replace on-site investigations with at-home examination of the facts. 

All existing state accountability legislation was studied kfr comprehensiveness and variety prior to the 
selection of Colorado, Connecticut Florida, and Michio^ for a sampling of accountability activity. The 
w^lhngness of the states to cooperate in the development erf tfie report also wgs^n important consideratiort- 

Careful review followed so that details of state legislation, implementation of the legislation; and major 
problems in the four states GQuld be recounted accurately. A valuable list of references and copies of the actual 
fegtslative-acts complete the monograph 

This addition to the list of Cooperative Accoun/ability Project (CAP) pub]icatio)^S:Should prove to be highly 
useful to educators and other individuals who w^iTt_and needj o know more aboul^the varied-appfoaches to 
educational accountability \n states other than their own. The monograph provides bd^th a means oj/comparisorL 
and an introduction to the hows, whys, and wherefores-of accountability. 

CAP IS in^bted to the authors and to the Wisconsin Department of Public Instruqiop^or this very useful 
addition to the accountability literature. 



"Arthur R Olson, Director , 
Cooperative Accountability Project 
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Tlie Wisconsin Department of Public Instruction, a member of the Cooperative Accountability Project (an 
ESS^, Title V project administered by the Colorado Department of Education) , has prepared this report 
de^rrbHVg the methods used by four states to achieve accountability through the assessment of students and 
theV/aljiiation of educational programs. The CAP Project Operations Board determined that a report of the 
.^rograraaXitseveral states wiljoJi^an^ Jaackgrounds and experiences in accouatatuiity would benefit other states 
in theiipearch for ways to introduce accountability methods into educational planning, Colorado, Connecticut, 
Florida and Mfchtgan weresetected for this purpose. 

^ Ed/jcational accountability;, the mam purpose qf which is to improve and increase student learning and 
achievement, is a concept th^t is approached by several means. Many states are engaged in establishing 
programs to obtain accountatrte results which indude such methods as assessment of student achievement; 
evaluation of educational programs; program planning and budgeting; management.-by-objectives; evaluation of 
professional employees; and/or perforrriance-bas^d school accreditation. Goals, objectives, and public 
reporting, along with attention to cq&t a^^^^tyses, havVemerged as essential elem*ents to incorporate into these 
methods or processes for attaining accountability. Equ^tt/important is the reflection that accountability entails a 
-corttinuous prdCess of involvement of educators and community citizens to bring" about the improvement of 
educational programs and student achievement. ' , V 

The four states addressed iMhis report are involved in several or all oMf>ese methods, but the amount of 
information that exists in these areas is so extensive that it would be impractical to include in one report every 
means used by the four stated to achieve their accountability aims. Since states nationwide are conducting , 
pr-ograms to assess student achievement or to evaluate theii; educational programs to,determine their impact 
upon student learning, our conclusion was to choose four states with legislation fonnc'reasing student learning 
and achievement through-assessment and evaluation of educational programs^^ahd to describe the processes 
and policieS'that they have instituted to implement their laws. 

The majority of the mater^l for the report was gathered from Jh^^^t^merous articles and state ^ducatipn 
agency publications from each oUjf\e four states which a^^^fnclOded in Wisconsin's State Educational 
Accountability Repository. A questionnaire and additionaf;;3rtquiries by telephone provided the rest of the 
information. A reference list of the publications used in thereport is contained in Appendix A. A draft of the 
report was sent to key state agency personnel for revisions and updating. ' ' " 

y 

The cooperation of state agency staffs in each^ of the four states is very much appreciated,;^,yte*f time;- 
patience, and effort were essential for the comple^n of this report. Special thanks for their invaluable a^istance 
are due to Dr. Arthur R. Olson/ CAP Project Dtfector, Mrs. Kathryn DePew, Dr. Leonard P. Landry, and Mrs.' 
Betty-Jo Rule of the Colorado Department of/Education; Dr. Crane Walker (cleceased) and Ms. Judy L. Haynes 
oijj^e Florida Department of Education/Dr. George Kinkade and Dr. Douglas Dopp. of the Connectrcut 
Department of Education; and CV RoberKl. Huv 
Department of Education. 




Huyser, Dr. Thomas H. Fisher, and Mrs. June Olsen of th6 Michigan 




Pl^yllis Hawthorne 
James H. Gold 

State Educational Accduntability Repository 
Departmeot of Public Instruction 
MacfisonTWisconsin j 



SECTIONIJNTRODUCTION . 

Many states now have legislative acts that authooze (JT napdate various pr^odesses for attaining accountability 
or for the development of a system of accountability. Some of these laws were imposed upon,state feduo^tion ^ 
agencies by state legislatures; others wet^Q sought by state education agencies to authorize and fund progfamsi. 
they wished to develop and establish. By 1974, 30"states had enacted laws that involved various approaches to , 
accountab»Uty. These include legislation jor state and/Or local assessment progj^rfi^ evaluation of education&f 
programs; development of educational goals and objectives; the institution^of'a'program planning and budget 
System (PPBS) ra"rrranagement information system (MIS) , or a panagement-by-objactive? (MBO) systerh/ 
evaluation:iof'professK)nal personnel;^and* accreditation of schools ba$ed partially, at least, pupil ggin in 
achievemenK.AII'these proces$es.are*cpnsidered to be ways and means foj obtaining accoucilable results in a 
state education system. Some states are putting these methods into prafctice wit^) yarying'd^rees of progress; 
others are just beginning, with the extent of their programs in action dependent upon both the interpretation of 
the laws by the state education agency and by the resources available to impFement them. - 

The laws vary frdm broad statements of intent, such as Connecticut's Jaw for the development of an 
•evaluation and assessment procedure to measure educational programs, or Wisconsin's law, which ^aflS foMhe 
developrn^nt of an as'sfessmeni prgfgram to measure pupil achievement, to those that are more cdmprehensive in 
scope. Such laws often include ^ecific details concerning various steps in the assessment of students aM also 
tie in the law wi.th other demands, for example, the identification- of and remedial assistance for low act\teving 
students (Michigan) , or cost analysis (Florida and ColoradoJ. , " ' 

Other states began without legtslatiort (Minnesota, Mislouri, and South Parolina, for exarr^lple) but are 
similarly involved in applying the concept of accountability to the educationaf process t^rough diverse means 
The application of tHe accountability concept to education-has come to public attention nationwide* indeed, 
more than nationwide, as indicated by informational requests to the Cooperative Accountability Project and 
SEAR which originate from the Can&dian provices, the British Isles, the European continent, and Australia, With 
or without laws, both the'establishment of educational goals and assessment have emerged as important^ 
beginnings in a process to achieve educational accountability. Most of the states conduct assessment programs 
or are planning to initiate them, including the butlying'possessions of Guam, Puerto Rico, and;he VJrglp Islands.^ 
More than 30'States have adopted educational goals - . .V 

There can hardly be any degree of accountatpility or meaning to the term without goals and assessment, 
whether they apply to the goals and assessment of a state |||p[tcy management oper^n or to a local school, its 
curriculum, teachers, and students. - • • ^ 

Three of the states in this report (Connecticut, Florida" and Michigan) are Operating sta^e assessment 
programs, the fourth (Colorado) is concentrating^upon local distric) accountabi|i^and assessment. All(fourof. 
these states have adopted educational goals 

Purpose and Subject of Report ^ ^ 

Educational Accountability in Four States (Colorado, Connecticut, Florida, stnd Kiichigan) was written to 
describe in detail the assessment and evaluation programs of the four statesVahd the development and 
implementation of steps they initiated to progress towardjhe goal of accountability. It is hoped that the 
expenences and techniqufes developed by the four states will proVe useful to other states with a similar intent in 
their plar>ning^nd and operation of accountability and as^sessment programs. An evaluation of the e^ectiveness 
^ Qfrthe fdur'states' programs and a critical analysis of their policies and strategies are not a part oflhisTeporJ. The 
purpose of the report is to represent to as current a degree as possible and as^accarately as possjble, the facts of 
what IS being done by these slates in the interpretation of their laws to Advance the concept of^ccountability. 

Since the main thrust of Wisconsin's role in the Cooperative Accountability Project is the examination of state 
haws thkt' relate to some aspect of the adcountability concept, spates with ^uch laws were selected from different 
piTtS of the coutry, as. well as mp^e with some yearsr(^ experience in diverse programs of assessment, the 
, evaluation of programs, or the implementation of accoun^tability models. The legislation for Colorado and Florida 
are titled Accountability Acts; Mjgtiigan enacted legislation for a state assessme^nt program that prOposeSMo 
accDfpplish'- several things; and /Connecticut's jaw Is simply a broad niandate fo> the .developiment of 
assessment and evaluation procedure. 



format of Report • . * ' . " 

Foltowing Section I, The Introduction, Section II of the report discusses the laws enacted by the four state's 
that are the basis for theK programs and.gives an explanation qfThe background of the Idgistgtion and th^ 
content of.tKe statutes , ^ \] «•"' ^ 

Sectfon III demonstrates how the laws aJ-e being put int^ action by each of the states.an(:^lie changes in fiolicy 
and strategy that to^k place ^ince they were ejpacted Several-tables compare how the states are inrjplementing . 
their program.s ^ C *^ , ' , r 

_.Ihe Colt^cte|Ac(;qgntabiJity Program is explained sepafa4©ly.at the begmnirtg of Sejetioo HI iSecause, unttke 
Connecticut, Florida, and Michigan, Colorado's program is not a state assessment program ^ncf canriQj be 
^Qnnpare\^o the assessment programs oT the other three stales » 

In the course of writing.about these activities, certainmajor issues emerged which are brp ugbttip m Section IV 
ofihe report for the reader tocontemplate and consider^* ^' / 

' _ / ■ ^ . ' . " . ' / . ^ • , . ^ 

^ Two appendixes complete the report Appeadix A an annotated reference list of state agency reports and 
Qthfer materials that w6re used in the research lor the report Appendix B presents' copies of M^e state laws that 
are covered in ;^er§p(ort Section II of the report begins wjtm discussiooof^theseJawS. 
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SECTION ii. ACCOUNtABILITY AND ASSESSMENT 
LEGISLATION OF THE FOUR STATES ^ 

y^^fntroduction ^ * 

' (kjicyado. ConnorctJCdt. Fionda. and Micrtigara nave enacted several la^s v^hictl^'re^iect the puDhc concern 
expre^d tn rf)e late '60s an^ early 70s with trse cost of ecucat«on, what pupiis are fearnirg anc ihe demand for 
• PeUer actbuifiting of local, state, and federal funds provided for educational p'-ograms Coiora(^ enacted an 
educat»ona(sccount^bilit/ statute .n 1971 for state anglocai accojntatHMy programs that placed an emphas<s 
upon locat diaJrict c^ontrof and meaningful public involveme^^t Connectrojt's 197 ^ law called for the development 
of an assessmenV ^nd evaluation proceoure to measure tne a6eQuacy^^^prrjr§fTf^^ oi the" educational 
. programs m the pu^biic schoo's. Connecticut's state assessment is not mandated. Du: t is being conducted wrin 
^ jpcal distnc: oarticipatipn on a samfpling bas^s* M.cnigan and Fia^da estaoi.shed comprehens-ve aws fa-- state 
/assessnent and evaluations programs -r 1970 a^o 1971 'esoeciweiy. A't^h an/e^phas-s more upon state 
supe'^iS'on ana control The iaws for, Fi6nda and M<:higan ^e^e crecedea oy^a^ 'pst-ated by the departments 
' * ' of education <n these states to authorize the deve'op^ent and imD^^memation an assessment a^d evaluation 
pla*^. Tne deveiooment of these statutes oy the four states engaged state agency personnel educators and their 
professional organizations, legislators and citizens tn consideraote aelioeranon pr-or to passage 

Laws concerning other aspects of accountab'i-ty were enactea by Colorado Connecticut, andi^londa that 
are conce^nedwith comprehensive glanmng. program planning and budgeting systems and/or the evaluation 
of professional personnel These statutes can found ^n Legip^uoajj^^^ States Accountabihly and 
Assessment m Education, a reguiany updated publication of the C/operath/e Accountabihty Pro;ect Although 
^ome mention is made of these laws, thts report 'S confined principally to thf .mplementation of 'aws tha^ere 
reflated tfl accountability as approached through assessment and evaluation The background ^d r^qurrenfents 
J ^o^ these laws are explaiaea more tulii^in the text that follows - ^ ^ * 

Colorado Legislation 
' ^ Background of the Ed^cat^onal Accountat?Hity Act of 1971 

•*^oals and Pefformance Objectives ^ C 

The move toward^ accountabttity ^n Colorado 'bega^ before 'the passage of the (ToloradO' Educational 
Accountability Act of 1971 (Title 22. Art^ple 7. C R S 1973) , State educatienal goaJS had befen defined and 
♦ ' adopted as early as*1S62 and were restated m 1971 (they now are being ffeviewed for revfsion) . Perlormance 
objectives consistent with the state goals werg* developed for the Colorado Evaluation Project, which was 
conducted in the 196^70 school year, and for the Title (^r. needs assessment program first operated by the 
Colorado Departrnent of Education's Assessnent and Evaluation Unit during 1970-7 1 The Colorado Evaluatibn 
Project was intro(}yced to fiekj teslC^^^mnon Status Measures cfoncurrentty with a pilot program m assessment 
and ewluation that measQfed the pedom^ce of students m terms of specijic objectives 

Title III needs-assefsment programs followed m subsequent ye^rs with school parttcipation on a voluntan/ 
^ tiBiSiS, the purpose of which was to assess perldrmance m .12 subject areas to d^ermine educatiorial needs. 
Each subject area was stated m terms of performance Objectives that specified what' a pupil should be abl^to 
accompHstiat the end of a given year m school The difference bejl\^een 'The stated objective. and the 
performance nr>easure(J became tHe Educational heed The needs assessment program continued through 1973 
in Colorado, but a ^1! scale assessment was.not funded for 19f4 * 

By the time the Colorado Accountabilrty Act was passed, the development of goafs and perfor/nance 
X objectives was i*iot ^ new experience for Colorado Sdud&torTaQd c^fr^sultentS m the ;stal# educatiqn agency, to 
addition, a substantial number' otteaohers had reviewed w/judgecj the appropriateness of thetobjecttves that 
had been prepared tor the heeds assessment program. ^ ^\ 



School Accreditation byContract^Ks, • - • . 

A'^c!'>e' s^g^-'^ca'^^ $*en !a-/^*'^^accau^taG"-y wa$*;aKer by Cotoraod wrrti tne adoption of an attemative 
5'a*e accea ^a'lC" D'og-^a'^ ca^.ec cc^^^ac: acc^eaitat c^. *irst or a oiio! ba^is 'n 1970 and then as a regular 
C'cg^a^ " ''972 Tne '^Ove !o/.iui^cc^ea ^a* o*^ Dy conf'aci pa^'aHe's the intent and purposes of the Colorado 
A:co-^'^*ao *. Ac* *or-:h€ e5*aD/s"^"^e^* CC3> sc^'OOr o sv.c* accoun^aontly prograrrs. Th6|^Lan is described in 
3 Cco^aao Deca^'r^e^* o^Ecjca-c^ ^ecc e<^* t^ea /A Sc^oc iriproiement Process- Accreditation by 



^'^e cc^'^aC' C'cgra'^ ^r^o^o^es l^pcr 'ne sianca^a state acced^tation orogram by emphasizing the 
'^eaSy'e'Te'~*'c* ^^u.ts tether t^a*^ np^'s Contract acc^ediiatjor m Coioraao is a continuous imfDrovement 
excess K- *2 Ta: encou''ages a Qca' scrrcoi d'S'^ ct tc develop its own standards based upon long-range plans 
•^'^e '"^^as '"^e Dup.'S n the 'Oca aisf^cts Tne P''ocess Pvoives (V*) community participation "^(2) goals 
a^^ CD.ec'ves ^3* mapage'^e'^'-Dv-oc ecive? ->*r-tQrfTative-^ and (5j reporting.^all of 

- A'^ a^e co'^cc'^erts c* ajr acco^'^taD iity sys^e^^ '^co?t^t>«Ted -ntb tne contract between the local board of 
e::^ca* a'^^ "^e Cccraac S'ate Boa^^-o* EducaitO^ s a comp^ehenstve. co^^ nuous. ard isng-range action 
c'a**' r .'.'^ c". 'ne oca d^s^^'ct ,aert.f es spec tfc sta'^ ana student cbjec-^-es and aevelops activities to attain the 
is'^c: .^es Ma^age"^e"*-c/-cDec' ves s a ^c-oa' cc^poneri t^ pia^. Agreement on the actfon plan 
o^'.vee'^ •'^e oca ^cnco dst^ c* ana t^e Co o^adc State Board o* ECucation. foHowed by fmpiemer.tation of the 
Zia'^ cc^s* t^tes accec :a: err 

^ne wora cc^D''e^'e"iS've 'he cortex* the pian aenotes tne .nciusion of broad schooi-conimunity 
c . 0 ver^e^-* as we- as a comp'ete stjdy^of 'he .nterreiationsHips a'^d irteroepenctence of every educatiorfat 
-joed.goa' co.ect've, program orac^ce. serv ce. and ''esou'^ee * 



Cc'"*"^uOuS piann -g' refe^s^^o cor*-nooos evaluation by^u'lding a senes of aftpraisaf checKpomts into thfe 
z^r tG^e'e^^" ne /^'hether the aesrea aims of the program a^e oeing acnieved by the means selected- for 
accG.Tspl.snment 

. Tne lerr" ''cng-^ange' signtfies t meiy ac^'On for br»nging about desirable dhange and preventing undesirable 
cnar^ge "^t) be effective, the long-rgnge pian should &eat least I've years 'n length 

Tne purpose of the cortrac* accred'taticr^rogram is expressed as follows m the Colorado Dep^tment of 
EOk-ca* reocr^ . / 



• A Aa/ to ipdividua'ize schooi-distnct accreditation by bas^ng-it on the particular needs of-the studeats in 
eacr d:s*rict \ : • 

i 

• A way to implement comprehensive, continuous, long-range planning by estabiishiRg specff^c staff 
» responsfbtiitJes and distnct^wide proc'edufes \ ^ ^ . , 

• A way to make the best possible use of all available resources by better relating to (a) k:hooI and* 
community, (b) needs, goals, and objeclives. (c) programs, practices, and services, id^ program 

• planning and Dudgetirig, (e) inputs, processes, outputs, and (f) coSTs and benefits 

• \ A v^a^to Determine results by establishing measurable objectives 

' • A way to.take timely action by charting a long-range operational plan of who is to do what at what time ^ 

The Colorado State B4)ard of Education believes that both the standard accred^fation program and the 
contract accreditation program should be acfomrnodated in the state. Consequently, contract accreditation 
was adopted by the State Board as a regular program by 1972," and both starxJard and contract accreditation 
programs are sustained in Colorado $t the present time Cor^.tract accreditation f^s been calfed the precursor of 
accountability by Colorado Department of Education staff, and the goals of thexontracl accreditation program 
and the accountability progralm dd. in fact. compfemintaff3 strengthen both programs 

* Roiland PowaA and Leonard P Landry. Schoof Irr^ov^ment Process AccreOitBtKX) iyy Cofttrmci (Oenver Department of 
Educafton. June. 1971) 

* fbkJ . - . • 
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By the beginning of the 1975-76 school year 20 of Colorado's 181 local school districts were^ partially under 
::ontract accreditation, 27 local school districts were fiilly und^r contract^ccreditation. By the end of the 1975- 
76 sctioot year. W addition at Colorado sctioot distncts wrtt have h^ade progress toward contf ac! accredtlatK)n.^ 

Interim Committee on Public Education and the Gibson Report 

The Colorado Educational Acc(^ntability Act was drafted and submitted to the-General Assembly tn 1971 
.^fter a two-year study pgriod by an Interim Committee on Public Education The Committee members included 
ten legislators and five educators and school patrons wlio were concerned about the costs of education and the 
benefits received by the students from their educational experiences < ^ 

Of major significance to the development of the Colorado Accountability Act of 1971 was a report prepared 
^ b/ John S Gibson. Professor at Tufts University and Director of the Lincoln Filene Center for Citizenship and 
Public Affairs This report was written in cooperation with the Chairman of the Interim Committee on Public. 
Education-and was supported by a grant from the Colorado*Department* of Education under Section 503. ESE A 
Tine V. 1963" Trre report, entitted On Quality in Education,'^ had a great deal of impact upon the drafting and 
passage of the Colorado Accountability Act of 197 V «t recommended that the Colorado General Assembly 
devise legislation to create an educational accountability program in the state 

Central to the contents o^the report'are the ideas that goals for quality m education should be established, 
specific objectives developed, and those educational decisions of the previous year which had an adverse or 
positive effect »n school processes and services ancL^udent achievement identified A periodic review of goals, 
and objectives^hould be made and a measurement ofstDdent achievement conducted. Consfderation should be 
given to relating accountability to educational costs The accountability program should t>e administered by the 
Colorado-Department of Education through an advisory-type accountability committee, in addition. local district 
accountability corrimittees should be appointed. All o\^these ideas were drafted into the language of the 
Colorado Educational Accountability Act of 1971 ^ 

Another impression gained from,.the report is the ]d|^a that alt o^lP people who make decisions about the 
education of students can advance the concept of accoWabtlity^Afiyne responsibjp for improving the quality of ^ 
education and for supplying the ^oo! services and p recuses. needed 50 that the students achieve t hg stated 
goals and objectives. The governor and the legislators of a state have to provide the resgurces and backing 
needed by the department of education to enhance the quality of education The departnpent of education has to 
provide the leadership and services needed tcT affect or impTove the quality of school services and processes^ 
Superintendents, principals, and teachers must provi*"«jsi^ific services and processes to advance sljj^ent 
achievement The decisions of all educational organiiations, ibsal bbatds of education, and school co^w^ees 
in a state can affect the quality of education. • ' . 

• The Colorado Accountability Act alludes to these ideas when it says that a purpose of the accountability 
program is to define and measure quality in education 'Reporting to students, parents, boards of education, 
educators, and the general public is suggested as an approach to be explored. The State Advisdry Corpmittee 
membership is to include Jegislators and citizens^ as well* as educators: local ac(?ountabtlity commtttee 
membership js to include local citizens as w^ as local educators. The role of the Colorado CMpartnrient of ^ 
Education iri assisting local school districts toWrengthen their educational programs is to be clarified Local 
school boards are to help their school patrons deVermine the relative value of their school programs compared to 
their cost.4i other words, the attainrrient of accouWabtlity is reached by the combined efforts of all segments of- 
educatiooal decision makers. The interrelationships and interdependence of these segments are expressed 
more precisely in the Rules and Regulations which were promulgated to carry out the directives of the Colorado - 
Accountability Act. (A copy of the Rules and Regulations is in Appendix B. and they are discussed m Section 

III.) . 'J : . 

PPBES and Confiprehensive Planning / * c 

Mention should be made of two oth^ laws enacted m -1971 4>ecause of their relationship to the Colorado 
Accountability Act enacted the same year. These laws are the PPBES Act (Program Planning, Budging, and 
Evaluation System) and the* Comprehensive -Educational Planning Act. The Compreher>sive Ecroajiona^ 
Planning Act (Title 22, Artrde 6. S. .101-11*. C.R.S. 1971) was er^actejd to provide frnanoat support for the 
development of school improvement plans under r^uirements that are similar to those needecl for local school 
district contract accreditation. Jt^ purpose of the PPBES Act was the-devetopment of a PPBES budget format 

' Johf\ S ^baon. On QtMHty tn ^duc$ti6n (Denver Departmont of Educttioo. Apr«. 1971) * * 

' ■■■■ ■ ■ -5 ' * 
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for use in \fte public schools t^at would present educational progranns in terms of pupil achleverhent and refate 
the program^ 10 cost 

. The Comprehenstve Educatiq||<^lanning Act no longer is funded, and,the PPBES Act was repealed in 1973 
because =1 proved to be unworkable in practice. A less restnctive law entitled the'Fjnar^ial Policies and 
Procedures Act (Title 22. Article 44, Parti. C R,S 1973) succeeded it in 1973 which is more compatible with 
the provisions of the 1971 Accountability Act As a result of the 1973 law, a Financial Policies and Procedures 
Handbook-has been prepaid for use by the local schopi districts-^.All the districts are required to prepare 
uniform budgets according to \he progranr-onented budget format c<5niained In the Handbook The purpose of 
the budget forma! rs lo relate anticipated costs and actual costs to designated programs. 

Principaf Component^ of the 1971 Educational Accountability Act 

Purpose 

^ i 

Tne Duroose o* the Educational Accountability Act is presented^t L^'^stttut ing an accountability progracn "to 
de*'ne ar^a ^easu'^e quality m education, and thus to help the,public schoolS a( Colorado to achieve such quality 
a'^d '0 expand the life opportunities and options of tl^e students, and to provide to local school boards assistance 
'n heiD'^g tneir school patrons to determine the relative value of their school program as compared to it's cost." 
Tne accountability program is ^'to measure objectively the adequacy and efficiency of the educational prograrris 
offerfed b/ the public scnoois " 

State and Local District Accountability Progr amd 

The law requires' that 5 state accountability program ancTloca! district accpuntability programs be developed. 
Tfte legislation, though conrjprehensive. /s not restrictive o\ dictatorial Local districts have control over t^et^ own 
^ goals. ODjectives. progra/n's. and evaluation approaches A ^tate assessmept is not mandated in the 
Accountabii'iy Act 



^n^le^a 



>m^t 



law does assign responsibilities that enable the school distncts to buifd programs for attaining 
accountabUi^ comnoensufate Wi{h 4he gerwa^ guidelines sta^ed^ the ^w. >TI>ese guideknes mclude Ihe 
deveiooment of broad goals and performance objectives at the state and local levels and the development of a 
System ^or evaluating the achievement and performance of the students at the local leveK Several approaches 
are Suggested for examination m 0evetoping an evaluation mechanism 

• A^means for deiermmmg whether de{/siQr>s affecting tjie educational process are advancing or impeding 
stuoent achievement / » , , 

• Devei^piiient of appropr^te testing procedures to provide relevant comparative data at ^east tn the fields 

o^ '-eading. language skHlS^^pd mathematical skills ^ ^ 

• Determination of th^ role gi tli^Depariment of Education in assisting school districts to Strengthen t/»eir 
educational programs / v ' ^' . 

• Reporting tp^students. parems, boards of education, educator^, and the general public on the performance 
^ of the puWicschools and providing daita for ibe^ppraisal pf S(^h performance 

• Provision o1 mforraation to help school districtsfincrea^se'theM' efficiency in using available fmancial 
' resources ' . " * . 

State Bo^rd of Education Duties / 

State Board of Education dutie$enco{npass the development of a state accountability program vyhiQfi will: 

, • Describe and provide fpr tmplerpentation of a pro(;^ure for the coKjjnupus exanrMnation and improvement 
\ of the goalstor education in the state * ' > >^ ^ 



Identify performance objecttves that wril lead to the achievq^n^t'of the stated jgbals. 



• Adopt a procedure for dgjgrmining the extent to which local school districts accomplish their performance 
objectives Develop evaluation instruments to provide the evaluation required, but not use standardized 

, tests as the sole rneans for providing the evaluation 

• Assist the local boards of education to'' prepare district goals and objectives and the procedures for 
measuring sctiool aistnct performance in reaching them 

• Recommend a procedure gnd timetable for the establishment of the local accountability programs 

• Adopt rules and regulations to implement the Act 

Advisory Committees ^ ' - 

A state advisory committee is required by law to assist the Colorado State Board of Education inYdentffying 
the procedures needed t© accomplish the requirements specified injhe Act. Local advisory comnhittees are to be 
appointedtbimake recommendations to the local school boards concerning the local accountability programs, 
although the local school boards maintain ftnal authority. Citizen involvement is emphasized in the membership 
both of the state and the local advisory committees 



Reports 8 

The law directs the looal school boards to report to t^ie resrdeats o< the school districts and to -the Colorado 
State Board of Education by December 31 annually on the extent of the achievement of thetr stated goals and 
objectives artd on the evaluation of educational decisrOns made dunngthe previous year that affected school 
services and processes. * The Colorado St^^ Board of Education is to report by March 1 on a yearly basis to the 
General Assembly on the progress of the state and local school district accountability programs and recommend 
any legislation it Ihin'ks is necessary to improve the educational quality in the state. 

Appropriation , . * 

The General Assembly appropriated $40,000 to the Colorado Department oT Education for the fiscal year 
beginning July 1. 1971, to carry out the implementatron of the Act. Funding tor the impi^entation of the Act 
Since the fiscal year 197 1-72 has be^n designated Irom within the Department of EducatioiVs general budge\, 

Colorado's costs for tne'fiscal year 1974-75 wefe;the costs of the District^ Planning and Accountability 
Services Unit of the Colorado Department of Education'for assisfmg the local districts to meet the accountability 
requirements under the law. The staff is composed of one supervisor, four consultants, and one secretary. The 
1974-75 tosts (excluding full-tfme equivalent salaries) amounted to $13,500 for printing, publications,,posta9e, 
photocopying, telephone, ap(;J travel. Eighty-five per cent of the costs were funded by the state. 
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' Connecticut legtetation 

In 197rthe Connecticut General Asse^bly enacted several laws for the evaluation of proems the passage 
of which can be attributed to the concerns of the public, legislatOfs,|and educatocs regarding education in the 
state at that time. Cooperation developed between theJ^slald^ and educators as their own reactions to these 
concerns became 'known to one another. The Cof*^CT:ut State Board of Education and the Connecticut 
Ger^al Assembly shared an interest *n advancing th^loiRpept of accountability and ioi improving the quality^ of , 
education throughout the state. An additional incentive was a mandate from the Governor's Office of Finance 
and Control that state agencies institute, a program planning and txidgettng system which the Connecticut 
Department of Education decided to implernent as soon as possible. * 

Title 10, S, 4. Conn, ^en, Stat,^ o ^ 

Agts were passed m 1971 in Connect*^ wTiich called for a penodic evaluation of specific programs, namely, 
evaluation of vocational and occupational education programs, programs for.. the disadvantaged,. speaal 
education, programs, federally funded programs, and expenrnental programs. THIe 10, S. 4. Conn. Gen. Stat 

• 1^f»v*tdl975f^«rKJR0aultttofit*tt«r«jmesed«es.L^ 
0totmb«r41 Mch yMT and to lh»StM8oftrd of ^MC^ 
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(Putjhc Act No 665) is the law which i§ primarily related to the Connecticut 1971-72 reading assessment. 
Before the legislation was enaoted. the Connecticut State Board of Education already had approved a 
Department of Education report and recommendations for a statewide needs assessment/^nd a staten^ent of 
goal^ upon.wWch the ass^ssn>ent shouW t>e based The Board approved of the r^commendattor^ but 
determined that the assessment should be a comprehensive study rather than merely meet the requirements of 
ESEATKIelll ' - ^ * ' ^ 

Title 10. S 4 (Public Act No 665) amended an earlier 1969 statute which had requested the Connecticut 
State Board of Education to submit to the Governor and the Connecticut General Assembly "an account of the 
condition of Ifie public schools and of thaamodnt and quality of instnjction therein and such other information as 
^ will apprise the Generai.Assembly of the^ue condition, progress and needs of public education." The 1971 Act 

* essentially retained tHe above statement but was fnore definitive in that it now asked the Connecticut State 
. Boa^d of Education to "develop an evaluation and assessment procedure to measure objectively the adequacy 

• and efficiencrof the educational programs offered by the public schools. . " The Conn^ticut State Board also 
was directed to recommend policies and programs designed to improve education in tHe state. 

The law is m keeping with the philosophy of Connecticut's State Board of Education, Commissioner, and staff 
of the Department of Education. Although it does not mandate a state assessment program, the Connecticut 
Department of Education is operating a continuing, statewide, objecttves-based assessment program that 
anjails the development of state educational goals and objectives. The 1971-72 reading assessment was 
•announced publicly by the Connecticut Slate Board in Octe)ber, 1971, it was tfie first cycle of a^senes of 
assessments planned in other subject areas. Science was assessed dunng the 1974^75 school year. A second 
readfig assessment was conducted in the fall of 1975 

' - ' t ^ 

■ ' ,\ ^ . • 
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Florida Legislation 
Background'of the Educational Accountability Act of 1.97 1 

Flonda's EducatiCSr^l Accountability Act of 1971 was initiated by the Florida Depaf^i^ent of Education' 
following-recommendations from the Commissioner of Education for th^ passage of pre^ipus laws so that he 
Vou^d carry out his F^sponsibilities for public education in the staje. An earlier law enacted in 1968, Section 
229 551, Florida Statutes, had instructed the Commissioner "to expand. . . the capatjjlity of the state 
, department of education for planning the state's strategy for effecting. constructive educajjpnal change, and 
providing, services necessary to achieve greater quafity in education." The Commissioner was further - 
if^tr-ucted to use "all appropriate management.tools, techniques, and practices which will cause the -state's 
educational programs to be more effective and which will provide the greatest economies in the maf^agement 
and operation of the state'? system of education. " 

^ it 

in order to carry out the instructions of Section 229.551. several pieces of legislatro^ere recommencled by 
the Commissioner in subsequent years. First, Ihe Commissioner defined the.malor role of the state in education 
in the form of nine statements ultimately adopted by^the Flonda State Board of Education m August; 1969. These 
statements included the establishment of state educational objectives in pnority order, sound financial support, 
minimum standards for achievement and quality controls, assistance to localities for evaluating results, an 
informationsystem, and efficient use of funds, among others. ' . 

The Commissioner j;ecommended legislation establishing an educational research and developnignt program 
in the Flonda Department of Education for developing new techniques to improve the quality of education. The 
Flonda State Legislature approved the Educational Research and Development Program in 1969 and^ 
appropriated a sum annually for sponsonng the program beginning witfi the f97&-71 fiscal year. The Research 
and Development Program contnbuted to Flonda's accountability efforts by developing preliminary objecti\jes 
and test Items for assessment and by pilottng alternative educational practices in the districts that are 
intedocked with several aspects of the accountability program. ^ 

.The Commissioner also recomnr>ended to tffe Flonda Legislature that statutory authorisation be afforded him 
to develop a plan for evaluating the effectiveness of educational programs. In response to his recommendation 
the Florida Legislature enacted THIe 15,T.S.A., S. 230.23 in 1970. This law authorized the Commissioner to 
develop evaluation procedures "Mesigned to assess objectively the educationaf programs offered by the public 
schools. . . and [develop] such methods as are necessary to assess the progress of students at various grade, 
levels." The plan was to provide each school district witb rpleN^nt comparative data and, to the ejctent possible, 



be compatfble with the National A^essment of €ducaJU©raf?rogress^Jbe<;ommissioner's plan was delivered to 
the Florida Sftate Legislature by March, 1971, under the \\\\eP!^fr1or Educational Assessment in Flonda. The 
1 97 1 Sta^ Legislature adopted theCornrnissioner^j^Jap-and^acted the Educational Accountability Act (Title 
t5,,^^/darSfaft/fes, S 229.57) tec^i^out the'pfOcedufesfecomfT^ 

In 1974 the FPorida Accountability Adt of 197rwas revised. The major provision§r of the revised^ Act are 
described in*the next section, as well as the differences between the original faw and the revised law 

Major Provisions 6f Florida's Revised Educational Accountabilily Act 

This law IS a comprehensive accountability statute based upon cos^efficiency and behavioral objectives. The 
Commissioner of Education is directed to implement a program of ^ucational accountability for the operation 
and m&nagemerkt of the public schools which shall include^the fc 

• The establishment of major or ultimate, basic, specific,. uniflfm, statewide educational objectives for each 
grade level'and subject area, including, but not limited to, feeding, writing, and mathematics in the public 
schools 

^ • A uniform, statewide system of assessment based in part on critenon-referenced tests and in part on norm- 
referenced tests to determine penodically pupil status, pupil progress, and the degree Of achievement of 
established educational objectives 

• Procedures for comparing statewide results to national ir>dicators of student performance 

• An annual public report of the'assessment results by grade and subject area for each school distnct and 
the state^^th ^rv analysis and recommendations concerning the costs and differential effectiveness Of 
instructiojBLpcograms ^ ' 

The scnool boards of the local districts are to make annual reports of the asseismentr^^ grade aad^ 
subject area for each school in the district and file a copy with the Commissioner pf Education,^ 

* The amendnienfs^n the revised law'whicT) Changed the 197 1 raw are suninianz^^ ^ 

• The '1971 Act specified the subject areas to be assessed without indurating grades: reading in 1971-72, 
reading, mathematics, and wrrtmg in 1972-73, ahd reading, writing/mathemat|cs, and oth^ subject areas 
in 1973-74. _ ' / ,^ i 

' • The W74 Act^ stipulated that all students in grades 3 and^ be a^s^l^din:fhe''sub|ect areas'af-jeaclin^, 
wnting.and^a4^ematicsin 1^74-75, and a//studentsin-grade$ (f%iij^^ ^/ 

' • No other subject are^^s to be testeduntil the assessment of readingbHivntlhg, ahd matherTja^ic^as, been 
implemented in grades 3 through 6. ^ . 

• Sfatewi^^|esults are to be compared to national indicators of sladentpe^^ ' . 

• An Kiterpretation of the results for each school shall be reported in thfe annual report q\ school progress. 
. . This report is to be prepared by each ^hool for 'the parents of aH ch>kJren in the sdhool. ^ 

' One other major change occurred in the Accountability Act becau9ej>f legislation en3Cted iln 1975. Both the 
original Acqountabihty Act of 1971 and the 1974 revised Accountability Acf directed the Gommissionehof 
Education toaevelop accreditation standards based upon the attainment of established educational objectives. 
' The 1975 Florida State Legislature discontinued state accreditation which, in effect, abolished this directive. 
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Michigan 



tlon 



Public Act No. 307, 1969 ( S. 14 of 




Budget) 




Michigan's assessment...pft5granr> was legislated by two laws. Section 14 of the Mip*iigan Department of 
'Education's approppation budget (Public Act No. 307) , enacted in August of 1^96^ was initiated by the 
Michigan StateP<J^d of Education following a propo^l by staff members in ttieJD^partment of EdCicatiop for a 
statewide e0<rcationa] assessment program. The lack^of reliable dat^-^cppcwiing the performance level of 
student$<^hools. and districts, and concerning the distnbiution andpr(5gress of education in the state gave 
impetus to the proposal It received the support of the State Superi^rt^dent of Public Instruttion, the Governor, 
and the Michigan l^egislature/ ^ 

The bill gave the Michigan Department of Education b^d authorization to develop a statevyide program for 
conducting "a periodic and comprehensive assessment of educational progress" that would measure 
educational outcomes objectively and to test annually pupil achieverpent in the basic skills at one or more '.grade 
levels Funding iff the amount of $250,000 was provided in the 1969-70 state appropriation budget. The first 
^assessment took piace in January. 1970 

ubiil>A£tNo. 38, 1970 (Vol. 18, Mich. C.L.A. 



Background 



Public Act No 38 was introduced by the Goverifi 
redesigned aspects of the assessment for 1970-7 
by the Michigan Department of Education, direct in 
and staff members testified at several legislative 
passage of this legislation 



S.388, 1081-1086) 



or, and it mandated a more comprehensive program that* 
and future assessments. Although the Act was not initiated" 
was supplied by Department staff to the Governor's staff, 
t^earings There were a numb^ of reasons that led to the 



pjt 



Initially, the Michigan Department of Education had decided upon a policy of not puBlicly identifying individual 
dislrrcts in reporting the results of the 1 9§9-70 assessmem. Instead, each district received the scores for its own 
schools confidentially, but the district was encouraged to release the informatiQn publicly. After the first results 
-were printed and released, there was strong^ gubernatorial and legislative pressure u^n the Michigan 
3rtment of Education to identify the cfcstncts and to supply comparative data on all of the schools in the state. 




A second fa^rhe<^^^gsthe amendment of the 1968 State School Aid Act. This law established a four-year 
program for assisting scTT5r?f945a^jng^^ of economically and educationally-deprive^ students. The 

1970-71 legislative session provideotltwitional funds for this purpose totaling $17.5 miHion ($22 million in the 
last year of the program) , and it was decided to tie some of these funds td the school district results of the 1969- 
70 assessment. Specific^plly, the results for grade 4 in tfie 1969-70 assessment were used to determine the 
ranking of each school oh two cntena^ (1) a high percentage of students with low socibeconomic status, and 



(2) a high percentage of students with a low achievement in basic skills. This legislation necess 
disclosure of all the schools' standmg$ in the assessment program. Public disclosure of local •< 
therefore became a niaaijatory policy for subsequent reports of the 1969-70 assessment^ 
assessments 




Individual pupil results were 



test construction, 
reliable and mear 
Jocal district 
could redesign 



not reported in the 




tedlhe^ublic 
ment resuljte 
as lor fut||^^ 



Short versions of conventional 



skills tests were used in the inte; ests of containing costs and minimizing testing time. Funds were not providei 





The short tefets assembled for the program were' design ed to produce results that would be 
gful for scHool- and district-size groups, an^lhese were reported back to the d^lwts. Soa>e 
ors felt tiat individual pupil results should be furnished to local school officials so that they 
ir prograr/s for specific low achievers. 



The Go^nor was particularly interested in^identifyjhg individoat pupils for the local districts in order to avail 
them of remedial assistance funds He wished to establish a firm, statutory base for a more comprehensive 
assessment program that reflected public disclosure of results and the wishes of his constituents. He introduced 
Public Act No 38, enacted inT^Wl^ • ^ • . . 
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\ Major Provisions of Public Act No. 38, 1970 ^ 

Purpose ' . . ' _^ 

The purpose bf the state assessment is to. provide the information needed to equalize educational 
opportunities for the students; to inrrprove and introduce fedocattonal programs to raise their level of achievement 
and improve the quality of education, and to identify the students in need of remedial assistance. 

Department of Education Directive^ ' - ^ 

The Michigan Department of Education is to be responsible fpr^developfng and conducting the state 
assessment program and may use the services 6 \ appropriate testing organizations or testing specialists. The 
Department is expecte9 to carry out the following directivesin the law: 

• The establishment of a statewide ann Jal assessment of^upifprogress in the achievement of basic skills 1/ 
reading, mathematics, language arts/ and/or other subject areas covering all studei^Js annually at twC 
grade levels in the public schools. The current testing of grades 4 and 7 should be e)^andl^. 

• Development of pupil achievement goals in the basic skills yf^ 

• Identification of the pupils with the greatest educational need in these skills 



Provision to the school systems of strong iricentives to introduce educatronal programs^or improvinfl 
education of the students in basic skills and model programs to raise the level of achievenient 

• Development of a systefn of educational' self-renewal that will continuously evaluate programs in the 
schools, thereby l>elping each school discover and introduce program changes to improve the quality of 

^ education , - ^ ' 

• The collection of other relevant information essp^a\ to thefas^essment program 

- ' . f 

Reports . * . ' . " ^ 

^ - ^ ' / — - 

The Michigan Department of Education is/to provide'the information needed for state-level decisions pboul- 
the allocation of state funds anc^ professiol^al services I0 enable students to achieve competence in the basic 
skills and to equalize educational opportunfW- Information from tine pr6gram also is to be provided as soon as 
possible to each school to assist in its^ffortsjb improve the achievement of its students in the basic skills, t^stly. 
=4he public IS to be informed periodically ooncpicning the progress of the state system of education. 

Remedial Assistance ^ V 

Based upon injormation from the assessment prqgran>, the Michigan Department of Education is to provide 
remedial assistance t)r6grams to the schoil districts, as funding is appropriated by the State Aid Act, to raise 
competency fn the basic skills of those students who have been identified as having extraordinary need for 

assistance. \ " . - , 

\ 



****** 



Section III of this reporlicJiscusses'the methods.being used and the progress reported by each state jp^he 
implementation of the statutes described in Seption II. , ' 



\ 




SECTION Mi. IMPLEMENTATION OF ACCOUNTABILITY 
LEGISL/^ON BY THE FOUR STATES 

In describing the implementation of the accountability legislation by the four states included in this reporty6nly 
the methods used by Cor\necticut> Florida, and Michigan for developing and conducting their state assessment 
programs can be compared. As noted in the Introduction, these three states operate state ass^sment 
programs. Colorado does not. Colorado runs a distinctive program of rts own to attain accounlabiiity, l:^ginning 
at the local school dismct level. The uniqueness of the program prevents comparisons between Colorado and 
the other three stated therefore, Colorado's accountability program is discussed separately from the other 
staies at the begm^ng of Section III. The rest of Section III is devoted to a comparison of the state assessment 
programs conducted in Connecticut, Flonda, and Michigan. 



^ Colorado Accountability 

State Accountability Advisory Committee 




^s required by the Colorado Accountability Act of 1971, a l7-member S.tate Accountability Advisory 
Committee was appointed to assist the State Board of Edp9ation in performing the Board's duties mandated in 
the Act The State ApcountabiJity Advisory Committe^is performing a decisive role in helping the Colorado State 
Board of Education implement the law by coordinating the accountability efforts of the local school districts iri 
tl^e state In addition, the State Advisory Committee relays^the^a, concerns, and points of view of the local 
educators and citizens back to the state education agency. ' ' , w 

The State Accountability Aalvispry,Committee has taken a'Strong position on the philosophy that procedures 
fopattatning-accountability m6st\not be irriposed upon the'Iocal distnctsirom the state level; they should move 
'I5jn the local level up to th'3s^t^ leveK with the local districts retainipg as much control over the.op^mtion of 
heir accoun'jta^ility programs.asW consistent with the-Tai/v This poafttion is endorsed by t^^Comrpissioner'of 
Education, State Board ofEduCation. and the Colorado Departrri^r^^ | " ^ ' - — 

To carrwbut the impfementatiora Of the Colorado Accountability Act under this pOljty, the State Advisory 
Committ^ has cooperated witti th^ Colorado Department of Education staff since 1971 in assisting thjS loj::al 
districts fo understand the accountability process and to proceed through five>steps fop developing locaf 
accountability programs identified in a s6t of Rules and Regulations for implementingJbe law. The Accountabitity 
Act mandated that the State Bpard 0f€ducation adopt rules and reg^aticrns to carryjbut the directives.in the 
Act; the State Advisory Committee was instrumental in executing this m&f^ate. 

Rules and Regulations ^ , ^ 

^ Two setspf Rules and Regulations have been adopted by the Colorado State BoaW of Education! The more 
>ecent set is a revision of the htst Rules ahd Regulations Some time limits structured ipto the frrs^set of Rules and 
Regulations were tied in with dates required by the 197 1 PPBES Act.and the 197 1 CdnnprehensiiVe Educational 
Planning Act. Since both of^se laws no longer vyere operating by 1973; the State Accour^tability. Advisory 
Commn^^initiated a study of the Rules and Regulations for the purpose of revising them. A revision requires 
pubtic hearings, adoption by the Colorado state Board of Education, and approval by the Atforney peneral of 
vColorado make the Rules legal. Recommended phanges were made based-^jpon suggestions frorrs local 
school districts, [c^cal conaKtntees, State A<jvisory Committee members;' and the Colorado Departrrient oTf 
Eddcatjon staff. The revised set of Rules was adopted by the State Board of Education in July, 1976 (see 
Appendix B for copy) , and was approved by the Attorney General of Colorado the following September, 

The changes in the 19^ ^Sjfls and Regulations clarified definitions; eliminated dates that no longer weVe 
relevant; established a more realistic reportir\g date for the local school districts' annual reports to'be submitted 
to the S.tate Board of EducaBpn; aqd^defiried more cleailj^ihe roles" and respphslbiiities of the participants in their 
accountability program. ^ 

if 

Although the Rules and Regulations serye as pr6cedural devices for administering the law. they do reflect th 
interpretation of the law by the State Board of B[ducation, the State Advisory Cortimittee. and the Coloradb 



Department of Education. The Rules clearly emphasize local autoViomy and the desirability of building 
accountability into Colorado's state ediJcalion system from the local school district level up to the state level. The 
interctependence and interrelationshipjs among the focal school district's board, superintendent, school 
administrators, teachers, locarcomm^t ees, and -the community are defined. The roles of, the Slate Board of 
Education, the State Advisory Committee, and the Colorado Department of Education are precisely drawn. The 
Icinguage of the Rules and Regulations \k punctuated throughout with the determinsition of the stafe's educators 
to 'introduce and gam acceptance of Accountability at the local level The special emphasis the Rules and 
Regulations place Upon local accourvtaSility programs and local autonomy creates the impression that there js 
less emphasis at this time on the state abcount^bility program. The language Expressed in tRe Rules veers away 
irom any semblance of control over the local districts, and Ihe State Board of Education emerges as a guiding 
jx)dy which establishes policies and Suggests procedures to assist the local districts in developing and ■ 
iTTiplementing their local accountability Programs. In the language of the Accountabvlity Act. the duties of the 
State Board are more definitive. The locil boards of education are given the authority by the Rules to establish 
their own timetables for the developmerjt and operatior? of local accountability programs; in the law. the State 
Board of Education was to have recommended a timetable for the establishment of the programs. One questions 
whether the Rulfes express the full intent df the Colorado Accountability Act as enacted by the Colorado General 
Assembly, but they do express how the-^ct has been interpreted by the state's educators to arrive at the sdme 
end result, and the educators feel that ^tate educational accountability cannot be fulfilled without the initial 
acceptance of educational accountabtlly by the local districts. The Rules and Regulations document is 
important because approval by the Attorney General of Colorado connotes the necessity for compliance with 
the Rules, therefore, they play a vital part \k ihe actual implementation of the law. 

Five sequential phases are stated in theiRules and Regulations as necessary steps through which local school 
districts must progress in order to develop l^cal accountability programs * 




'1 . Develop, analyze, redefine, and impro^^ea statement of goalsfor the district 

2, Idehttfy and prepare statements of student outcome objectives smd staff objectives for Nie district 

3. improve, modify, or develop programs \o achte\;e the student outcome objectives and siaff objectives of 
thedistricJ' - . . " - • 

. . 4. Determine, evaluate, and report the strenghs, weaknesses, accomplishments, and costs of the 
established programs in terms of the goals. Student outcome-objectives, and staff Objectives of the di^rict 

'5. Redefine arrd modify, based on evidence from th^evaluation procedure, any of the parts or characteristics 
of a program through planning, budgeting, ^nd decision making ^ ^ 

. I ■ ^ ^ • - ^, 

The revised Rules and Regulations require ^11 local school boards to account for the expenditures of money 
ahd the commitment ofWienesources in terms of the results achieved by their accountability programs. For this 
* accountjng. the districts are to follow theforfnat contained in a handbook' which was developed ^cording to 
directives in the 1973 Financial Pqlicieg anS Procedures Act. 



DisseminatiSh of Information . * ^' * ' I ^ - 

' Following the passage of the Colorado Accountability Act and the adoption of the first set of Rules >and 
Regulations, an explanation of the Act ar^d^a draft of the first Rules and Regulations were sent to distnct 
superintendents throughout the state. A brochure was. prepared for public explanation of the Act, and press 
releases were sent out. Panel discussion groups took place between the Colorado Department of Education staff 
- and local district school groups and citizens. Accountabilrty !ea03s were trained by Department of EducatioQ 
staff to assist'the districts in numerous; statewide regional workshops and.trajping sessions. Consultative services 
still are provided to the local districts, pnncipally by Department of Education staff, to^help the districts prepare 
student and sjaff objectives and to aid progress through oth^r aspects of ttre ^local district accountability 
process.' „ - . . ' 



* Au^. EtiucationalAccoumMbmy Act df 197 1 (Denver: State Department of Edpc?ition, July. 1 975) . p^S. 

■ - : 23 - • : 



Local District Reporting - - . . ^ 

A detailed report form is sent to the local school disjricfs each year to acquire infoi^^nation about theif activities 
"as thedi^tricts progress in their accountabimy programs. Local school district reports are used by the Colorado 
State Board ol Education as a basis for the Board's March 1 annual report to thex:olorado General Assembly. 
Four* annual •State Board of Education ^reports have been completed since the enactment of the accountability 
law. 

The local school districts also must report the progress of their accountabijity programs to their school^ 
patrons. Many ofthe districts are makinj^ this attempt, but uncertainty about collecting the information needed,^ 
the best way to report it. and what should be expected has created problems for the districts. Guidelines now are 
being devised by Colorado Department of Education^fi^oHelp ttre districts in this task. 

Colorado Education Qoals \. 

Colorado's Educational Accountability Xct of 1971 mandated the development of a continuous goal review 
procedure to improve the state goals for edwcatioa knd to encourage the establishment of local district goals. 
The state goals had been restated in 1971 aVd v^re denvqd from an earlier set of goals adopted by the State 
Board of Education in 1962. The impact of thVjSibson report* was a factor in the restatement of these goals, 
which was undertaken largely througti the ^l^s of the Colorado Department of Education staff. Citizens* 
statements gathered during meetings in ^st\years and research on' how and why students learn were 
ir^vestigated. JMe Colorado Title III needSrefssessments were referenced to the 197 1 goal^ Colorado now is in'the 
process of^vising the state,goals through a new review procedure adopted by the State Board of Education in 
1972 Jf!e initiation of this procedure In January of 1974 constitutes an 'important step in the formulsftion of the 
state accountability program. - 

Goal Review'Procedure ^ ^ ' ^ 

The goal review procedure was developed under the initiative of the State Advisor/ Committee in cooperation 
With the Colorado Departrrrent of Education staff. The plan Involves a much wider representation of the state's 
Citizens in the goal development process than was the case ih 1971, and the goals are expected to be fineflized in 
1976, The new review process ^s baseol^rupon the position, upheld by the State/Board oVEducation, the State 
Advisory CommiUefe^and the Colorado .Department of Education, that fipal statewide goals should rel^ect and 
support the de^s expressed in the local school district goals. ^ 



•Thegf^Uas)i;"Df the Department of Education staff and tfie State Advisopy^ Committee was to assist the local • 
distncTsirTc<^ the prepara^tion of focal district, goals tn accordance with the law .Jo accomplish this step, 
theiDep^mnent of Educati6n staff spent considerable time in regional workshops disseminating to the distncts 
infqrmafion about the development of goals. As a result of the workshops and consulting services, loCal district 
go^ either new or revised, have .been developed by approximately 98 per cen^ of the 1^1 school districts in 
Colorado. Most of these- goals are broad statements of educational purpose. Others, are broad guidelines for 
curncuf^pr^ areas, and seme in volve-mininlum^programs. ^ * '. J/ 

Public participation in the local district' accountability programs is encouraged in the Jaw, and many of the^ 
districts engaged \h a. number of activities to involve their [ocal communities In the gbal development proce^. 
.Open meetings were held; and discussions were conoucjed with parent groups, ,minonties,^ac!minlstrativew 
gFoups. teacher gwups, and the school boards. Community groups such as business and labor organizations 
alsotookpart. ' - ^ - ^' ' / 

^ . ' ^ ^ , V' ^ ^ • , . - , 

• ' , - ^ Analysis of Loc^Distrit^ Goals " , / 

When approximately 68 per certt ofthe loc^schdbf dis<ricf&had filed their district goals with the State Boarcf^ 
of Education, asumonary and analysis 6f the ^Oals was completedin May, 1974, as a dissertationyOy a doctoral 
candidate at the University of.polorado. From thist-an^lysis of thfe local district goals, anC^With the advjce W the^ 
Stale Advisory'pommittea.^.the' Colorado Department of Education's/Division for Evaluation 'and Planning 
•proposed Snmitfal set of nine state learner outcome goals. ^ ' ^ - ^ ' \/ ; ^ , 

' • ' ' • • • ' ./ . . ^ ' A' 

^ Dr. Joffn S. Gitielot) of Tufts University. BoSton. was hirdd as; a cdnsultant to ihe Colorado State lejjislatfve's Cornmlttftft #d Public 
Educ#tk)a. He refornmtftcled restatement of Cblora^^^^^ . ^ • 



Discussion Groups ' 

The nine prc^posed goals are being.circujateci to representative groups of citizens for their reactions in a series , 
of discussion ponfe^-ences thrt)ughout Colorado. Assistahce iM appointing.the nnembership of the representative 
discussion groups was sought from school superinteodents and the local accountaBility advisory committees. 

Rotating ^fubcommittee 

A rotating subcommittee will assist the State Advisory Committee with the discussion conferences ^d in 
analyzing the comment^ and recommendations of the discussion groups* The subcomnrvittee will be composted 
of State Accountability Advisory Committee members, members of the local accountability committees ap^ 
local school boards, and local district citizens, parents, and students. The subcommittee will be responsibl^or 
preparing a^ second set of goals that will reflect the comments of the discassior> groups. The second set will be 
submjtted'to selected persons in the dis9ussion groups 'io venfy the subcommittee's jnterpretation of their 
stateoienfs. * , ' • ^ ' . ' 

Final State, Goals % " , 

• . ^ ' 

The State Advisory Committeeplans to have a final set of state goals ready for adoption by the State Board of 
Eduqation in 1976. The State Advisory Committee recojnmends thsrt the final state goals serve as^ guide for the 
state and its agencies in the preparation and implementation of educational plans and programs that 
supplement local district efforts. The Committee suggests that ^ review of the state goals take place every two 
years! ^ ' • - - . 

Develppment Of Performance Objectives 

, The Coloracio AccoCint^b'i^ity Act, also mandates that performance objectives be identified which will lead 
directly to the achievement of the stated goals. Local school districts must determine the extent td which tb^y 
'accomplish their performance objectives. As wifh hew state goals, performance objectives are being 
developed in the local schoordi^trrcts fjrst, and whgn at least 'Iwo-thirds of the districts have developed- their" 
objectives, they will be analyzed and state performance objecttvesrelated to the local district objfecUves will be 
developed from this analysis. . * . , ' ' 

Local District Performance Objectives - - , , 

'V ^ • ^ , . . ^ 

The local -school districts received assistance in the writing of ^ performance objectives from field 
representatives and project coordinators of the Colorado Department of Educatipn in a substantial number of 
meetings and worksh'dps located* around thfeetate and through individual' visits. Most of the ipCal distncts 
irtiplerhented a plan, for developing objectivesjollowing the workshops^ and some-were abte'kt€ write their 
objegtfves. Other's sought further consultative assistance directl^^from the Colorado Department oJ€ducation or . 
the Board of Cooperative Services; a few districts o^d independent consultants? However, consultants from th.e . 
Colorado Department' of Education are the primary source the^ fbcal districts use for assistance in -the 
development of local performance obje'ctjves. : 

In-service trainin'g in^wnting objectiveSMS pr6vid^d*j3y many district^ toMocal accountability comfnittee 
membets, teachers, administrators, specialists, para-professionals, and support personnel. -Although a few 
citizens have taken part in developingrObjectiveatn some of the districts, teachers and administrators are th^ 
predominant source for writing the objectives. « me studer^t outcome objectives }hat have be,en v\^itten are 
concentratedmamlymthesubjeCtareasof mathematics, reading! aod language arts. « ^ * 

^ Progress by the local districts through the first two sequential steps'of poals and peHormance objectives 
expressed in the Rules and Regulations for* tha development of focal accountability programii§ under way. J'he 
Four//? Annual Reporloin theEducahonalAccountabihty Act'ot /97f containsinfofmation about' the progress of 
llhe'disthcts in the dev^opmen't of local, accountability programjS/^nd in areas where the distcicts need further 
assistance. | - ^ ^ *' T / * , ' ' . ^ »/ ' 



Fourth Amuat Piepon on the Education^ Accountebilify Act of 1971 ^(Denver: State D^rtment of Education. 1976) 




Results Reported by Local Districts in theiPourth Annual Report' * * / 

*' . ' ' - . r ' . . ' . 

. . There ar^ Ij^local school districts m Colorado. Of thispumber ^ 168 (AstnctaVaported \n \me to be irvGlujJed \n 
^e Fourth Annual Report pgblished'by the State Board of Educ^tron early in 1975. This'report reveals what way 
'apcomplished by the l^cal school districts in the 1973-74 academic year. Eight local district Reports wer^'^ 
r^ceive^j too Tate foV' inclusion in the Annual Report; fiVe oJher local ^^istricts^did not conjply with the law's 
wectrve to complete the repbrts. ' v 

i\ ' . ' • ' ' .V; - " . 

' • A total ot 166 of the 168 local school district^ reported* thfet they bad funptidnin^l^k;,^ accountability i 

feomniittees 'with a higher percentage of membership composed of parents, stufehts, and citizens IK 

''professional educators. Ethnic groups.and economic groyps w^re represented on a majority of the convnittees. 

The law stresses public involvement in the membership or [he local advispry cbmmit|ees»* 

Loc^Lboards of education of 89 per cent (150) of the reporting districts received recomniendations frbm. 
their local advisory committees Wliifih suggested steps Jor upgrading the t^uality of studej:n learning^ Jf^e 
re^omrriendations reflected the Gombih^d thirfkirig of It^e district and comrriunity, and tliiey t^yered areals of , 
in$truction,curnctilum,evaluaiion, staff, students, and'facilities. is " • • . ' ' « . * 

' x'*'*' ''^"^ ' r ^ i ' 

Two m^jor activities of the local sclmit districts ddl^jj^j^'^^ yeap^ere {^) the development of 

local distnct student outcomeobjective^o support ^t^epurposes of the gwls^^fla (2) the rfev^ew and revision of 
curriculum and instru9tion in terms of th^i^rpp^s andtntent of tlie go^lsand objeotiyes. Student putC' 
objectives generally were establisheci first tty mefocal school districts, tojf)^ fotlowfed by.tjie^evetepmeilTorsfaff' 
'objectives. . , / ' ^ ' ./-f^'—^^-^ - ^ ; ^ 

Based upoTi information received from 16§ districts repo^rting for W^e-^ourth Annual R&port, 69 di^^ictshad 
be^Lin work on the development of stuclSnt and staff objectives. FortV-ttir^edistricts said HiSt they: were' vjfbrking 
on the development of e//her student' or staff objectives... Thirty-eight dislrictsr were planning to^deyfeiop student^- 
and staff objective? during 1974-75. Eighteen districts did not resp^jnd to the questjon, and pcesuhl^bly ndvyork 
or planning is being^^&ne m these districts on the de^eioptnent of pbjecfivea * • ^ . ' ' ^ * • ^ 

. The Ideal districts are beginning to use their gpals and objectivesin the short-tQtm and long-range pl^nhin^ of 
educational programs. ■ As a r^ult of establishing goafs and obj^tives, dbnstfuctiyechangeS'in curricukim-wefe 
made by the local school distriotsjn which instructionai programs were fjjacedJn a m?5reJogiCal order, curJIcJTum 
'guides were developed, specific .courses were added,- and staff positions to support a/iff maintain thith'a^ges 
v\^ere established. The basic purpose Of the changes iih curriculum was to coor^linate an^ arti<Jlj.la)e* the 
educational prpgrams from kindergarten through 4he twelfth gra*de.- ' ' . ^ * '< * - * . 

( * * e ^ ; r ^ ( 

Additional constructive *chahC|es'were made by the local school districts in instructilJ^V v^hich included the 
review and updSting^^ of exisffng prografns;.^tHe addition of new courses; the, stressing Df individualized 
approach* to learning; and the plannihg of alternative educational program$( work shidy programs, and 
inndyative learning experiences. The basic purpose of the instructional changes was to brpaden the experiences ) 
'andopportunitie$of the students andto plan progrfemstoinlerest'tne students and fulfill their needs. 

'There have been other results. Some local school districts-are incllSding in their annual reports information- 
Qoncerning bfith the successful and uRSuccfessfui attemprt^^madejjfrestablishing their.*programs so that other^ 
distficts can. benefit frotn these e^peri^ces. 

Staff organization and responsibilities are being designed in some lo^dl districts with a view ^IRrd 
management-by-objectives approach. Three local school -districts, have adopted and- are irnddjrontfng ay 
mandgementnby-objectivessyste^^ ' ' " * * ^ 

^ As a result of citizen membership on the local advisory committees, more prodj^jj^^ommunit/ an. 
professional relationships have been developed. There is mo're community unllerstandjj^^ the focal t^oax&i 
education's decisions ahd programs, and the tocal boards receive the benefits of thi^j™^ Qf view e)^es^a by 
comniurrity members. Ar\ estirriated one-half of Ihe loc3l School board of edugj|S^jff nrtenpbers elifecfed in the 
♦ spring of t973 w6re former memberjs of the local accountability'idvisory oommit' 




in 



Ahother important resuj^^ig tMjQcrease in cxftftmunicatipn'and services thfins takjng place betjA^een the st^te 
edygatiQQ agency aryJ the local district's.. ^- ^ > ' • / ^ • 



further Assistance Neected by the Lopal School DisW^ * *^ 

Vef y Jew^ of the local districts have worked through the total processes of ilevelopinq and measunng goals and 
'objectives at the school borfdtng level; 'evakiettng thetr pfogr ams m tef^BS of the fesull$: and comp*^ t*ie^co^ 
*bf their programs to'their relative value One of the most difficult steps for the locat districts is interfacing thar 
district student outcome. objective with existing educational programs afthe school buildinqjevet Some- 
districts' are concentrating on measuring objectives in -one or two programs such as language arts and 
. •mathematics. Others plan to implement both student and staff objectives m all ^eir^programs Some district^ are 
developing specifjc objectives at the subject matter level and the classroom level. ' ^ • 

^"^-v^^local districts use a number of measures to gather mformaiton ^bout the strengths and weaknesses ot 
/ tneir programs, but standardized tests, teacherrr^de tests, and Observation still are the methods most frequently 

/ used Some crrtenon-refereaced testing is being tned by the districts t)f the*168 local school districts who 
reported on this area of questioning. 90 per ceht (151) used standardize test^ during 1973-74.. 30 percent 
(51) used commer'cial -criterion-referenced tests, and 33 per cent (37) used distnct-develop^d cntenon- 
referenced tests' Cnterion-referenced measurement and in-service programs to familiarize Ihe staff with 
Evaluative skills and techniques were stared by the Tocal districts to be foremost needs ' 

. Concernfpg cost prcxedures. fhe Fourth Annual Report stales that 69 districts wer^ in the preliminary stages 
. of deveiopirig methods for determjomg the costs of prpgr^s. but few were able to gjle'ldelalled analyses of the 
"cos^effpctivenessoftheif programs « . 1 ^ ' ^ 

Asubstantial amount of work and ^Jedication lies ahead tfir the Colorado De0&r<ment*o1 Education "staff and. 
the State Accourltability Adyisory Committee to provide the assistance needed by the local school districts tg. 
advance m these areas One of the primary considerations now receiving attention from the Colorado 

< Department of Education and 1he Advisory Cogimittee is a major need expressed both by the locaf school 
districts and by the local accountability advisory committees This neert>jis for a program evaluation procedure 
that will contmousJy evaluate programs in terms of the districts' priorities, goal^s^nd objectives Such an 
evaluation procedure was approved by the State Board of Education m the spnng^974; it wiil sen^eas a>t)aS4C 

s framework for the local districts to follow in evaluating their programs. y ^ 

Evaluation Pfocedure , ^ 

The Colorado 'Accountability Act directed the State Bogrd of Education to develop an evaluatibn system that 
the local districts pould use to measiire the achievements of their educational prograrhs and the impact of |he 
programs upon student learning.. The Colorado Department of. Education appointed a subconimtttee^to 
formulate an initial design for this procedure. Members from thQ^State Accountability AdvisorJ^ommfttee ^d- 
from th4 local school distnctsrserved on the subconnmittee The drafted pfan waspresent'ed to the Accountabilriy 
Advisory Committee Tor^revievi! aftd^ecommendations After revisions were made, it was presented to the 
Colorado State Board of Education and approved by the State Bo^ird in May of 1974. , 

The evaluation dest^ outlines k series of six mafor steps which (he local school districts can feUow to provide 
X for. the con|irHial upgrading of the districts' educational pr6grams on an annual basis The'specific procedure 
tMat each disfTict works oi4rfrom the suggested st^s in the evaluation plan is left up to the -discretion of the 
district. Altfioogh the focal school districts mainty have been using standardized and teacher-made tests to 
measure t^re achieveme^its of'therr educational progr'am'^. there iS an awareness -^hat traditional tes^g'onfy te 
.not a wholly suitable measurement for- a district's objectives. The evaluation procedure suggests^crtterion- 
referenced testing as anbther means k)r-mfeasunng achievement. The original pOn outtmesihe si<|Bvafuafion 
steps in detail, but they may t)e briefly ^a<ed as follows: - " ' - '^^-^ ' . 

• De^nptton of the ro/es /n an evaluadon procedure (who is involved and where iofeated; wherfe the areas gft 
cofjcefn are and what should be looked.at) . - , . 

""^ • ^ Wpat iS befng rneasured Equality in;education through determintncrihe degree of accompfishmAt in terrr>s 
\ ^ of student and staff objecti^ m the schoo* buildrngs and districts; the strengths and weaKrtessesH:?f4he 
programs v> terms of student an'd stafTobjectives; the effect .the accountabifity process is having on 
% . learning and'ff^eprqgr^ cost at the disjlrct and siate level) - • / 

\ \ Inforrh^t^ gathering (what might be ddfl^ to setect^ii^dediind useful ^ntornte5p^^ what means migfet be 
used to gather thtf information; and analysis of the data) . >. * . • • ' 

. • . ; ... M ; .... 



Reporting the informatibn and fa^^fhered (b^hom. reporting dates, and kinds of informal to be 

/eporied) 




• Useoflheinformawnand^actsltuywi^ ■ • ^ ' * * - 

4 * % ^ 

^. • ^esu/fs from me os^o/r/7e/n/orm'af/on (major educational decisioris) • ' < 

Objectives of the Local School Districts for 1974-75 - 

Of the 168 local school dislnctl reporfmg in the Fourth Annual Report, 145 districts stated wh^^t th^r 
objectives for 1974-75 would stress.NUiey indicated the major emphasis in achieving accouQtabiNty for 19^4-75 
would take place both at the local school district level and at the school building level : y 

At the school building level/broad student-'oulcome objectives are to be matched vwm. the e^jucgt/bnal 
programs in the buildings where the students are located. The changes resulting from the 1973-74 review and 
revision of curriculum and the consideration of alterhative approaches to instruction are to be adapted to the 
school buildings ' . , - 

At the focai^hooj distnct level, currerrtM^ork on student outcome objectives is to continue. Existing distfJCt- , 
level objectwes will be reviewed, and the development of staff objectives will be initiated. New and nrjore effective 
approaches for the evaluation of the staff are t9 be considered a'hd outlined to encourage personal and • 
professional growth. The planning and operation of in-service training programs to me^j^t staff needs bro^t^". 
about by changes in curriculum and instructionsihanagement will be developed. The design of locarevaluattprf 
jroce,dures to help the. districts determine the success or failure of the achievemen1s^jfj|jeireducaf»dr«^ 
outcomes, as well as to assist the districts m using collected information, is to be continued. ^^"^ "\ - 

To sum up the progress that is being made m CoJdrado with local distnct and state accountabtlity p^ogranfe, 
Table 1 indicates the directives in th^ Cotor^do Accountability Act that are accomplished or in progress and 
IfiDsethatstinh^vetobeattatf.'^d- ' * . <- ' 

The State Board^f Education, the State Advisory Gommitlee, and ^he Cokxado Department of €duQ^*6ip 
have taken the approach of first ^establishing a firm foundation in the local districts for understanding tbe, 
-accountability process ana wotktng from c?ne step to the nexUo attain accountable results. The De'partmenljqrf 
'Education staW and the State ^visory Committee provide th^echnical a^ssistance and support needed by ihg 
local districts as they rrjgve frqm onedse^uence to tfie'ney inr the operation of their accountability plans. Th^ 
three educatibc bodies recognize that Accountability is net an instantly attained goal, but requires substani/art 
planning." time, and open commor^ation between the state j^ducatton agepcy and the local districts. ^ - ^^^^ 

^Procedure for §valu^tton Wnhin theAccountabtfny Proce^ {Denvef- Department of Educattoh, August, 1975) . pp 1-6, . \ 



Table 1 

Sbtus of Implementation of tfie Colorado Accountability Act 



Directives Completed or in Progress * ' " Future Objectives 


State Accountability Advisory Committee appointed 
and functioning 

Local Accountability advisory committees appointed 
and functioning 

Revised Rules and Regulations to administer' Ac- 
countability Act adopted by the State Boar-d of 
Education ^ 

Local district goals prepared by 98% of 1he local 
districts ^ 

Devdfcpment ot performance objectives by the local 
distncts IS processing, though not Completed by all 
of thedistncts . 

: f s > . 

Evaluation'procedure adopted by the State Board as 
a guide for local district developriQent of evaluation 
procedures 

State Annual reports prepared fpr .the General As* 
semtsdy * 

Local distnct anndal reports prepared ior the State- 
Board of Education * 

Local district reQor^s to .sctiool^^atrons prepared by 
majority of the districts - * 


Completion of tScal distnct student and staff *per-~ 
formance objectives and putting them into operation 
at the school building level - ^ 

Completion of state goals revision, the firs! step in 
developing a state accountabilityprogram 

Preparatfon of state perforn^nce objectives 

Development of local evaluation procedures and 
cnterion-referenced test instruments to measuFe 
acljievements of educational progranr>s and their 
impact upon student learning 

Developgnent of a cost-benefit analysis approach lor 
local district programs 

Asststancelo local districts in tfie preparation of local 
reports for school patFons • ' 

Application of r^utts of evalu^tron to upgrade edu- 
cational program^ and direct future ptarnmg. deci-* 
sion rfiaking, and budgeting ^ 

* 



The next portiog of Seetiort 111 compares the methods used by Connecticut, Flgnda. and Michigan m , 
conduct'ingttheir state assessmefit pcograms. Beginning with the development of state educationalcgoals 
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Development of State Edueational Goalsl5y-CCTmeeficut, Florlda^d 
\ • . Michigan \ ^ 

Introdgction > 

Educational goais fall tnto three caiegones •(!) /earner outcome goals, whicti are stud0nt-onented and 
represent what a pupil'shouid be a^e to accomplish at some point; (2) process goals, which are related^ 
instructional methods and (fther ci^ssfoonvactrvfttes to. facilitate attainfnent of learner outc(5fte^eate,'and (3) 
management goals, which are organizationaJ in stpjctureand provide the support necessary for fmplementing 
botrr learner outcome goals and institutional goals The discussion of goals la.this report is directed mainly to 
learner outcome goals • ' . ' ' ' - \ 

Learner outcome goals represent desired pupil achievement expressed in general statements ^oTbroad 
direction. purpose, ana intent^ Each state ma^t work out its own process for establishing learneroutcome goals. 
Mostdiscussions about establishing goals state that it is essential to involve teachers because they may resent 
benCr^c^jDntable for goalsJhey did not help to select In addition ta involving educators in determining goals, 
^^)arents. studeriis. community members, and anyone else who will be affected by the goal decisions should take 
par; IP their selection if they are to be lully effective. Determining goals is a political process because the goal 
decisions need to repitse^t different values in the community or state, and compromises have to be made. 
Furthe>more it is^enerally recognized mat goals *ou!d not remain statrcbut should be subject to evaluation and 
•j revision refJectmg changes m society • — > - •* ■ 

The Subject areas of learner outcome goals are m*arkedly similar m most states but are expressed in tjifaerent 
ways ar-d,w}th vaned degrees of emphasis to embody Uie concepts and phifosophy of gach state's edui^onal 
system. The four states mcluded in this report are no exception to this obs^ation, de^spite the use of somewhat - 
avfferent n^ethods to cievelop their god<s. Listed are 1 1 broad goal areas, the'ffrst ten of which the four states 
have in common and to which all of their learner outcome goals can be related. The eleventh goal is cited by • 
Michigan alone as important to cjevelop withm each individual. The subject areas of these goals are not listed m. 
pr'oray order \ \J * 

r Acquisrtion basic skills • ^ ' 

2 Devel^^entof the a^bility for creative, constructive' and cj^ticalthinkirig- , . * . 

3 Unde*rstanding of the democratic process: responsible citizenship 

4 Occupational preparation and awareness, economic under^nding 

5 Development of aesthetic at>d^cultural understanding and appreciation , '* \- 

6 Physical and mental health - * 

7^ Social development; human relations * ■ ^ . . ^ , * • ./ 

' B Preparation for home and famil^celationships •* , * m \ 

'9. Self-worthand self-understanding i ; ; " ' ' . - , 

, 10^^"^onyhuation of education beyond formal . / 

ri , Appreciati(5h, maintenance, ppotectior^ a^nd improvement of the physical environment 

How Cploradojs rev^su1g its state gOals already fias b^n'described; the tfi^hods'^sed by Connecticut, 
•Florida, and Mrchigan Tolbw. Of these three states, orty Michigan 'Estate f^ls were mandated by law. . ' 
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Connecticut Goals 



Goals Group, . 

TJie inrtial prppatation of learner outcome goals m Connecticut wascopdoc^^^by professionai members of . 
the Connecticut Department of' Education who werje abetted by Tne stiong^ leadership of the state's 
Commissioner of Educatiqin. Federal grant requirements and' the funds available made it necessary 'to use a 
tentative statement of goals<jeveloped by statf members and to present the statement to a representative cross 
section of the state's population for reacijpn a t the sa me time the assessment was in progress; in 1971-72. The 
Executive Group, a unit set up in the Conr^lcti^^Jt Department of Education n February, 1971, to be respor^sible 
for the assessment, reoommended three potffessional staff members to constitute a Goals^Group. 

The Goals Group proposed six major learner outcome gdals that^re derived from several sources: official^ 
state department positions and policies;^ National Assessment for fSucational Progress: assessment reports ot 
other states. Center for, the Study of Evaluation (CSE) of the\ University of California, the New England 
Educational Assessment pfoject, special studies by the Befmont Project and the Joint Federal/ State Task Force 
on Evaluation, and other relevant educational literature A series of subgoals or broad objectives for eath major 
goal was solicited by the Goals Group from the entire professionai staff of the Connecticut Department of 
Education. These were reviewed by the CSoals Group and refined to a number that totaled 82 subgoals. 

Learner Outcome Goals and Mission Statemenfs ^ 

The SIX major learner outcome goate imlially proposed by theGoals Group were submitted to the Connecticut 
State Board of Education and' were accepted, b^t not fmally adopted, by the State Board of Education as 
working goals for gs ein th e 1971-72 state assessment program. The Connecticut Department of Education now 
"ts-in ttie 'prscess of reevaluating Department management goals which are being, formulated' as mission 
statements. The mission statements will be related to the learner outcome goals. ' 

Public Survey i>J4-earner Outpome Goals • 

The Connecticut State Board ot Education contracted with the Institute forjhe Study ot Inquirfng Systems 
(I StS) in Philadetpma to' ottam pubtic response andreactforrto the proposedstx maj€fr goate and 82su^gGa*S. - 
"Tl)ei3rogram was directed and rnonitored^y the Executive Group, j^ .. ^ , 

TheCdmitiissioner of Edacation invited representation on two consultKig cornmittees from educational, 
heaUh, fraternal, welfare^, business, labor, jndustnal, and governmental organizations. Jhese, con^mittees. 
assisted n devising^ methods for disseminating the cpals questionnaires to b ^ross sectfon of citnens and 
provided to the State Bbard of Education reaCtibnsfrgrv their respectiye^organizations regarding the results of 
thestiJdy ' . / ^ ' ^ ' ' ^ 

The method'forobtairttng public response to the propose ^oateinvolved a rmil^rvey consisting of two 
forms. A long form cohtaaikd all. the goals and subgoais and was stent to educSrtors and professionals. Ten ' 
-different $hon forms, dfef^uted to parents^ students, and other lay persons', contained all six m'ajor goafs and 
approximately 40 fJer'cent 0f the subgoals.There was no distinction made between the mam goals and the ' 

, subgorfs listed on tHfe'f(»iBls. All were presented in random order ^or the purpose of deterrrilnirig'Comhion^ 
attiti^ies held by yanqM^^^ps of persons. Respooderits wefe a^^ for their age and sex, and whetfjer they/*^ 
were?a student, a pan^r^bhool teacher, administrator,' or none of these. Approximately 25,O00 copies of \rt9i: 
long and shorrfo/ms ^^i&g distributed'tthrough maitmg procedures, usmg the Connecticut Departnjent of;; 

^ education's news pubhciSiton or- delivery to the schopJs. A cross ^tion of professional educators, communily-. 
leaders, schqol' board tnembers, members of profesdonal organizations, nonprofessional *hool ennployees^:, 
students, ^nd parents w^^' reached by this process: More thanS,000 replies were receive^ that were sutable for 
Analysis. . * * - * ' » ' , ' \^ . . . • 

^' A major purpose of the«u(5y wa^ to establish the goals in prftw-ity xSrcfer ^ that a series of subieot areas cogk* 
be schfe^lufedfof a^sessrnent. Theirecftiency of response for th^six^fiajor goals Qited at' randorn among the 82* 
SMt>goate resulted if^' a. placement of first, eighth, eteventh, thirteenth, and twenty-fpurth in rank. When one 
-Studfefe^the subgoals chosen in pre^ef^ce to ^ nF^jor g$a1,it is evidiw^ that,^l^n» setected subgoate arereteted ' 
;tp one of the nriajor goals. The majbr goals are. stafed'tiioTe broadly lhan 4Y?any of^the subgoals. The n^ajor goal ' 



that won ttrst place among the respondents states that each student should "team to communicate effectively," 
The first assessment m reading measured part of this goal. ' 



. ^ • Ftorida Goals 

Florida's educatiorral goals were developed by a group of Florida Department of 'Education staff members 
who mad^ a study of thp goals developed t?y other states and proposed a set of goals for circulation within the 
Department fof cnttcfsrrt/ Public involvement could not take place because.of the immediate deadlines created 
by the Florida Educrational Accountability Act of 197 1 The law required assessment of statewide objectives for 
reading less than a year after it was enacied. The Flonda Department of Education xietermineti that a set of 
broad educational goals should be used as a basis for the formulation of the learner outcome objectives required 
by th^ Florida Accountability- Act and that the goals should guide the dir^tion of management "planning to 
improve the state educational system. After Jhe Florida Department of Education approved the proposed set of 
goals.^y were adopted by the Stat|.Board of. Education early in 1971. ^ ' . 

All of Florida's goals are expressed in terms of goal areas which contain several -sObgoals, There are seven 
learner, outcome goal ^reas with 18 ^ubgoals and three management goal areas with ll subgoals. The 
management goals identify the state's responsibilities for developing and implementing strategies (hat will help 
students achieve the learner objectives, and they call for an evaluation of the state system of publifc edutatiofh m 
terms of student achievement and the efficiency of the educational system's proceSsses. The Department of 
Education staff feels that the learner outcome go^lsare expressed broalflly enough to be appropriate at the local 
district and school level, andjh^y are supplemented by local district goal statements, Florida does not have a set 
goal review procedure, but wiH modify the goals as social concerns change; nor are the gj9als stated in priority 
order The Florida Department of Education staff members feel that the question of priorityis more itpplicable to 
objectives than to goals. ^ ' • 



Michigan Goats 



The earlier Michigan assessments of 1969-70, t970;7U3'nd 1971-72 measured the perforn^ance of schools 
and students^n .terms of a generafty agreed upon goal of "achievement in the basic skilb." The Cornrhpn Goals 
ofMiChigan Education, a^ they are titled, were not adopted untfl the Fall of 1971. Michigan chose the task force 
and Citizen survey route to establish goals. ' * : - 

Task Force on Goals ' * 

— - ^ i . V 

The Task Force on Gbals, which was appointed;by the Michigan State Board o{ Education in early "1970, was 
composed of 21 members who represented- teachers, school superintendents, homemakers, btisinessmeh, 
religious congregations, students, state universities, Michigan Department of Education staff, local boards of 
education, and citizens. The Task Force was asked to develop and draft a statement of educatlonll goals against 
whiCh the assessment program couW be measured. Recommendations were^resented by the Task Force to the 
State Board of Education jn Junfe, 1970, and the Board made revisionsar\d additior^io the goals document, 

TheCommon Goals Of^ichigan Education'' * K .J. - r s 

A tenlajtve sfatement'ol goals was distributed 16 25,000 Michigan educators and interested citizens in 
Dec^ber, >97p. In thespring of 197 1 , a series of 25 public meetings wafis^ld iri intermediate afSi focal school 
districts to obta^i the opinioc^s and desir^ of local cifizens and educator^ regardihg the tentative set of goals.- 
The Michigan State Board pi Education analyzed the opinions and concerns and revised the goals accordingly. 
The Conrvnon Goals •Of Michigan Education- were, adopted -by the .Michigan State Board of^Bducation in* 
Septefhber,'19f?"1. ♦ , * . • 

• The goals are intended to be comnrjon to air public school system\-in the state>Local sfchbof drstricts are 
ericot'i^aged to expand upon the state's Common Goals and develop their own local district and schoW goals 
appQppnate for t heir sch ool systems, / ' • ^' 

. . ' ' 22 ' . • ' • ' . 
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the goals contain three process-onented goals which descrrbe wjiat criteria schools must meet to help 
students develop and achieve, as well as six management goals concerned with the conditions necessary for the 
success of a school operation. Thirteen additional goals specify desired learner outcomes. They are not listed in 
priority order. " . * t . 

GoalRevfew J 

The Michigan Department of Education believe/ that the goals should be -reviewed in the long term and h^s 
established a review procedure. The Council o^ementary and Secondary Education ariso will be reviewing tH^ 
goals annuall y for changes that new information may suggest. 

Table 2 sums up for comparison the pr^iRcipal approaches taken by each of the three states to develop goals 
andthekindsof goals that were developed. ^ 



The nei^t portion of Section III discusses the development of performance objectives by Qonnecticut, Florida, 
and Michigan for the purpose of measuring progfess toward the attainment of the stated goals. 



Table 2 

Development of State Educational Goals 



ERLC 



CONNECTICUT 


FLORIDA 


MICHIGAN 


Legal Requirement^ 


f 

Leyai neQUtremenis 




None 


None 


State goals mandated 


Steps in Goal Development 


Steps in Goal Development 


A 

Steps in Goal Development 


Temanve statement of goals devet- ' 
oped by SDE staff 

Derived from offical SDE policies; 
NAE'P;iMher. states' goals; relevant 
,ed(lcationa( literature 

Goals accepted in 1971 t>y State 
Board of Edugatjon for use m 

- 1971-72 assessments but not 

-formally adopted 


. Developed by SDE ^taff «fKl ctrcu^ ~ 
lated withtrt SDE; no pubhc involv- 
ment due to timeconstraints 

Derived from other state's goals 

Adopted by State Board of Educa- 
tion in 13?4^ 

Goals, will be modified as social 
cdncernS change 


Task Force appotnted with broad 
public /professional rnembership' 
to draft statement of goals 

Draft statement proposed by Task 
Force revised by State Bpard of 
Education 

Tentative goals draft submitted to 
25.000 citizens and educator^ 
throughout state 


Cpntracted with commercial Utp 
to obtain public response and^i- 
ority order of goals using mail oj"- 
vey of state's citizens ^ , i 




Public meetings held in local dis- 
tricts to obtain reaction to goals 

Following anal/sis q\ citizen opin- 
ions, final version of goals adop^^, 
by Slate Board of Education Pv,^ 


♦ 


%^ 

Products 


Review procedure established by v 
SDE for long-term use , 


^ Products 

J. ^ » 


Products 

/ 


1 S«x mifxi learner outcome g6als ^ 
c ,«nd 82 subgoals in priority order 

. - * ^* - 


Seven . learner outcome gdafe; 
three management goals; 30 sul>- 
goais 


Three process-oriented goals; six- 
management.goals; 13 fearner but- 
come goals 
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D'evelopiifient of Perfoririance Objectives by Connecticut, Florida, and 
\ . ■ Michigan * 

tntroduction ^ 

The Outcomes of student behavior or performance can be measured in terms of performance objectives that 
evolve from or are related to stated geals. The development of performance objectives can be managed by a 
commercial firm that specializes in the preparation of performance objectives, or the objectives can be 
developed by the staff of an educatipn agency with the help of the agency's own consultants and subject area 
specialis^l, as welf as pirotessional educators from local district schools, universities, and educational 
organizations i%the state. Many statements of performance objectives already exist and are available to state 
education agencies for review and possible adoption after they have been adapted to the state's own goals. 
Initial sets of otJjecti^es can be prepared by these methods and then be reviewed not only by the professional 
educators in the state. buValso by the state's citizens, students, parents, legislators, and members of the boards 
of education A review of performance objectives by different groups of persons is a time-consuming projefct but 
a very important one in the long run for improving the objectives and for gaming acceptance of their use in an 
assessment or evaluation program Most states contract with a commercial firm to obtain performar;ice 
objectives for beginning assessments/but after one or two years of experience, the assessment staff is apt to 
involve the state and local district professional educators and citizens in the development and review of 
performance objectives. _ 

The methods used by the three states to prepare performance objectives are described in this portion of 
Section III, Florida and Michigan in particular have had wide experience in the development of performance 
objectives and have prepared catalogues of />bjectives over a period of several years; this entailed considerable 
participation by professional and lay persons in these states. Both states are continually rooking for ways" to 
improve their objectives, they now are proposing new methodsior developing and revising th^. ^ 



Connecticut Objectives 

Connecticut's first assessment was conducted in Tyiarch,^ 1972^ /or rea_ding,_and it was determined that it 
should parallel the National Assessment of Educational Progress to s^ve time and /noney 3nd to provide 
comparative data on a^state, regional, 'and national basis. It was the first completed state assessment in the 
country that was based upon NAEP models and materials, according to a letter written to the Commis^oner of 
Educaton in September of 1972 by the administrative director of the Natronal Assessment of Educational 
Progress. Maine must have been a close second because the first Maine Assessment of Educational Progress 
was conducted in May of 1972 in citizenship and wnting, and it too used the National Assessment model.<^ 

Four of 'the learner outcome reading objectives tti^t were formulated by reading specialists and other 
educators in the^onnecticut Department of Education for a representative sample of 9-, 13- and 17ryear*old 
' public scHool students were matched to National Assessment objectives and' released test exercises. A fifth 
objective could not be measured by any of the released NAEP items and* wa%.«mitted. The matching was 
performed by the contractor, the Institute for the Study otinquiring Systems, PWI&delphia. 

Approximate!/ ten objectives were measured in th4 Febaiary, 1975. assessment. ConnecticutagaiA matched 
thejr objectives with^^AE? objectives arid test exercises for the majority used in the §6sessmer1rt,^ but also 
include some that were chosen by a saence conrtRfntlee of six Co/inecticyf^teachers from an objective barjK 
supplied by Measur^ent Pfesearch Center. t • ^ ' • / 

• In the second assessment in reading, which tool^ place in the fall of 1975 for eighth graders, themajonty of the 
objectives were selected by Connecticut teaghers and reading specialists from a commercial firnrvA^gw N*AEP 
objectives were used tp permit comparisons with the first reading assessment results.'^^Wie'^^ecticut 
Departmeqt of Educatioh' feels that local involvement in the selection of objectives will encourage ^greatt# 
accept^nce-of the pfQgram>tQSults3t the local leveT. ^ - } V 
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f lorida Objectives 



Initial Development — ^ 

Florida's first assessment m 1 97 1-72 in reading had to take^la'cp^ss than a^l^ear after the Florida Educational 
Accountability Act was passed, imposing serious constraints Vi the d^elop^i^ of objectives and test items. 
The Research and Development Section of the Florida Department of Educatiwi Ciantracted with the Center for 
the Study of Evaluation (CSE) , University of California- at Los Angeles, to supply a catalogue oi reading 
objectives and Items for grade 2 (age^,andgrade4 (age9K. 

• Committees tn each Florida school district, totaling 1 12 read^ng specialists and 236 classroom teachers, were 
asked to determine the grade level at which each objeefive should be achieved and then to select the objective^ 
with the highest priority from the CSE catalogue. No limitation was placed on the number of objectives that coOfd 
be Elected, arid the result waS that almost all were chosen. Si(ice there wemoo many objectives to assess, a 
reading consult^was hired to reduce the TTst to a mor^ractical_size. _ 

The Evaluation Section of the Florida Department of Education then organized the reduced list and submitted 
It for approval to The State Board of Education The objectives were adopted by the State Board in Septemoerr 
1971. 

Expanded Procedure with Local District Participation 

From this approach, Roridrturned to more in-state educators, t^hers, arf^ lay persons for developing 
performance objectives For the 1972-73 assessment, preliminary cataftigues of performance objectives were 
prepared under contract by Dade County for mathematics, by Broward Cfeunty for writing, and by Florida State 
University for reading, the three subject areas that were required by law to be assessed in 1972-73. The local 
districts' and University's activiteS were supervised by the Research and Development Section and by subject 
area specialists rn the Florida Department of Education. ArLadvisory committee m each of the three subject 
areas worked with the subject 'area sp^ialists and made a4)reliminary selection of the mathematics, reading, 
and writing objectives from the completed catalogues 

through its distnct coordinator of .accountability, each district was requested to form committees to select the 
Objectives TO t>e measured in the assessment program. Membership on the c^^mm^ttees was determined tiy the 
districts, but the district (Coordinator suggested that teachers, administrators, curriculum specialists, parents, 
students, and other lay persons be incruded. Selection of the objectives by the eemmittees took place from April 
to June, \9TZ '^^e comfnittee members were asked to select a limited number of objectives from a preliminary 
list for each grade and age level. A consolidated response was prepared by each district thanndicatpc^ the 
o&jeetives the district believed should be included. The tabulations of the district responses showed the total 
nOmber of districts that selected an objective and the weighted proportion ( by rfep ii l ation) of districts that 
selectedan objective, the tabulations were used by the subject area consultants and advisory committees to 
, choose a final set of statewide objectives. ' ^ ' \ 

The final lists again were returned to the districts to make surejf}at ft^friportant objectives were omitted 
Following final approval from the school districts,-the objectives^er^pre^nted to the Florida State Board .of 
Education forfedoption. Objectives in reading, writing, and matKSm^iicsfor|tL^dents 8, 11. and 14 years of atge 
^were adbpled in August, 1972. They were published uhder a 1972 BppyrigSt, and they were made available to 
^ tffe districts % use as instructional resources as well as for the state assessment program Science objectives, 
^ used for the fit$t tinr^ in the 1 973-74 assessment, were'developed by thasame metho d. ' ^ 



Proceckjre Proposed for Future Development * . ^ 

This instructTonally oriertT5l*-prro^ for selecting performance obj^tives has been followed by the Florida 
Department of Educatiorfup to the prtsent time, but thei>§cai:liwa(it is proposing a/iew ^edurefo^the 
' future Staff^embers feenbat sfeveral problems arose becauste of the specificity of the objectives. Thg prtrriarv 
problem v^as t>tar the objk:tWS fem^o.detailed to communicate to the public or the Florida Stale Legislature. 
Specificity also restricted thefefrf of a test item when there might have been a more effective way to measure a 
skill FurthjBrmore many objecflives represented intewnediate instructional g9als rather than terminal outcome 
-goals/One of the 1974 ameddments tojhe Florida-Educational Accourttabilit/Act of 1971 requires that nfiajor, 
terminal objectives be established. * ♦ - ' . ' . ' . 
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The Rorida Department of Education's new plan sets up an advisory committee to identify' the essential 
terminal skills that every child should be e;r^ected to attain, as a minirpurtS, upon completion of his or her 
education. Representation on ihe committee favors noneducators and includes ^parents, legislators, and 
members of business organizations, as well as members Of some educational associations. 

. The terminal skills the advisory committee selects wilH)e analyzed by subject area speclalist^'to determine jhe 
particular proficiencies necessary to acquire the terminal skills and at what age and grade level. Objectives will 
be Worded as genera) skill statements which can, be understood more readily by the i^blic than were previous 
specific performance objectives. To establish uniform constraints for item corfetru'ction, the minimum and ' 
maximum limits^ot what is expected of each skill at each grade )evel will be specifiejj. ^ * 

Local distnct.Gomn^ittees will substantiate the appropriateness and completeness of the objectives, after 
which they will. be' adopted by the Flonda State Board oftdwcation on a three-year basis in onjer to furnish 
stability to the state assessment program, and to give^the distncts time to provide i^truction in the skills. 
Students will be assessed on the objectives at three to five intervals dunng the schoolyears.* A procedure will be 
mstituted for reviewing and revising the objecti^s to maintain their relevancy ' ^- 



Michigan Ottjectiyi^ 



Michigan has been developing performance objectives by a systematic procedure for the pasf several years. , 
For The first four years of the Michigan assessment program, beginning in January, 1970, the performar?ce of 
students in grades 4 and 7 was^neasured in terms of a generally agreed upon goal of '*2^chiev^ment m the basio^ 
skills." and norm-referenced/tests were used. Objecjive-referenced tests, developed along with the effort to . 
prepare performance objectives, were first used to measure performance objectives in reading and 
mathematics, grades 4 a;^ 7, in Ihe 1973-74 assessment. - 

Workshops ^ ^ 

The develoEnjpnt of miW^al performance objectives*' to measure the adopted set of 1971 goals began in 

• 1971 with apreliminarv/^ne/of workshop^ in each .subject area under the direction of the Michigan Department 
of Educafipn's Insjj^tjcrnat^Specialist. Program olthe Generai Educalion Services. The workshops., were ^ 
attended by» subjerct area educators at various levels, including representatives from local district schools, 
universities, arKl teachers' councils such as the Detroit Area Council df Teachers of Math^atics. These 
educators vy<5rked m cooperation with curnculum and research specialists in the Michigan Department of. 
Education; • ' ' ^ . ' 

Eleven of these'groups were organized for w'orkshops held in the fall of 1971 to prepare the initial drafts of. 
pn/nimal performance objectives for grades K-9 in the eight subject areas of mathematics, scieqce,'soci^ 
studies.^communication skills (jncluding foreign language) , ar,t, music, health, arid physical education. Befqre 
drafting the objectives, each member of each group was asked what hepr sh^ thought should be .the minimum 
^ expectancies in his or her specialized area for Michigan pupils at the en^ of a specific grade level. 

Drafts frofn^.the 1 1 groups were Sent to additional Michigan educators and teachers in all regions of the state 
to obtain their comments and appraisals, a process which resulted in preliminary revisions. The responsibility for 
the dissemination of each draft was assigned to an instructional specialist in the Michigan Department of 
Education, and the specialist maintained a list of|hose persons who reviewed and revised the objectives. 

Grade Level Commissjons ^ ^ . , ^ 

. The drajts v\iith th^ pceliminaty -revisibftS^were sent n^xt to 13 Grade level CorVimissions, established in 
November, 1971, composed* of school administrators, L^A board members, teachers, curriculum specialists>, 
parenp, and lay citizens, the last of whom were nominated for membership by various professionaPand civic 

* organizations in the state. At least two revisions and sometimes more resulted from each of these reviews. ' 



•A iDlnimal perfoimtnce objective is delink by Mlchlgart « one that represents a nece^afy^Mt* Knowledge, or underslfi^HMlli 
commonly taught In att the schools, which n^ all pupAs shouW be expected to learn by the end of a s)]m^ grade level E D. 



Elementary and Secpndary Education Council • . ^ ^ 

The revised objectives then w6re sent to the 25-member Elemer>tary and Secondary Education Council, an- , 
adyis6ry body appointed by the Michigan Slate Board of Education and made up Uf professional educators from . 
educational organizations and mstitotions of higher education, parents, and lay persons. After review arid' 
suggested revisions by this group, the objectives were sent to the (vlichigan State Board of Education for final 
review/adoption, and distribution to the state's schfeols. ^ ' , 



SubjectAreas of Michigarf Objectives < ; *^ 

The Midhigan State Board of Education adopTed-in 1973, and publishpd in 1973 ^nd 1974, performance 
obiectives m'the eight learning areasfor various grades from kindergarteh t'o Grade 12 as shown in T^le 3. 

• . ; ■ - 

Tables 

Subject Area and Grade L*ev6l of Michigan Performance Objectives 
Adopted and Published by State Board of Education 



Subject Area " 


Grade Level (end of) 




Mathematics^rithmetic. measurement..geometry, , 
algebra, probability; and statistics) 


Represents a continuum; K-3. 4-6,J-9 




Communication skiHs (reading, speaking/listening, 
writing) ' \ , • \, 


Grades 3, 6. and 9 
* 




Foreign language (French, German. Spanish) 

a' 


Nongraded 




Science ^ 


Grades 3/6. and 9 . 


- - 


Physical education 


-taraaes J, b. ana y- 




V^ealth - ^ , 

Mu^sip^(elementary. secondary, and instrumental) - 


.Grades 3. 6. and 9 




Grades 3:6, 9» and 12 




Art .(elementary in affective domain) ^ ' • 


Grades Sand 6 




Art (secondary m affecttve^^psychomotor. and 
, cognitive domains) 


Grades 9 and 12 . 




^ 












^ ' ■ > • . 




** 
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P'articipatton of Special Groups 



It may be^ interesting to the 'reader to note which special group^>iri' Michigan were, represented in 
deveiop'fnent of the pertormance objectives m the several subject areas 



the 



MatntfrfTatics - , 

r 

CommuniCal'On SKii'S 

' i : 

► Foreign' Language 
Science ' . 

Pnysicai Educat;cr> 

Heaitn Education. 
Music 

Aft 



Michigan CoungI of Teachers of Mathematics* ^ - 

Detroit Area CounciLof Te^'hers of Mathematics ' ^ * • 

Greater Fiint Council of Teachers ©f Mathematics 

Michigar;) CounciJ of Teachers of fnglis^ ' . 

Midhigan Intermediate Readihg Association ' • - » 

Michigan Reading Association 

Michigan Speech Association " ■ 

Mifchigan Foreign Language Association - . ^ . . * 

Metropolitan Detroit Science Teachers Association ; 
Michigan Association of'Science Educatiori -Specialists 
Michigan Science Teachers Association 

Michigan Association for.H'ealth, Physical Education and Recreation 
Upper ^idwes] RegionaUntersbte Project * * 

Health education professionafs, but no specjalized gr£)up 

.% • 

Michigan Music Educators' Organization • 
Michigan «Schoot Band and Or9hestf$i Associatiorl - 
Michigari School Vo'cal Association.' 

Michigan Chaf^ter of the Aitierican Stnng Teachers' Association 

Michigan Art Educators' Association 

Michigan Art€ducaffon Directors' Organizatiqn ^ 



Current Plaos > y ' 

The^Michigan Deparlr^ient of Ectucatieri- initiated a field testing fiirogram m 1974 iia which 'teachers volunteered 
usa'the gssessmfenr Objectives for validation purposes. The 6bject^esin this program have been evahjated by 
1 1 elem^htary schpdls^and seven secondary schools. The Department of Education also is contTacting for a 
survey of educators to determine whether the educatlonaLprofession agrees that the published objectrves 
constitute essential mmrmal skill objectives desirable for most students to attain. ^ ' . ' • ' 

Contracts vyere issued to the Michigan CounciF of. Teachers of Mathematics and the Michigan Reading 
Association tq obtain their recommendations for improving the, quality of the objectives and the assessmenl ' 
program, foHowihg a revjew of the results of the 1973-74 assessment. * , • . - 

' ' - * C - 

Eanly m t975 the Michigan Sffete Board of Education adopted a statement which reopmrneotied-^^lhat ' 
expansion o(theassessment progr^ tp th)e fir$t^ tenth, and twistfthrg'rades bepostpone^t-Zor two y^a'rs^ but that . 
pilot testirtg opRe assessmenHtems for these grades be cOfTtmijed. Perforniance obfettives for grade'l2 are 
being developed for pilot testing. Pre-pnmary objectives in cognitive, affective; ^d|)sychomotor domains for 
^ra<je 1 were pilot-tested dunng the 1974-75 and 1975-76 assessmentsr-Gracf6TOofc|jeo<4i<^ in readfng and 
mathemaiipsWerepilot-testedm the 1975-76 assessment. Ai^of the performance objectlvesfoJ^rade 10 were 
tak^ from the sets d grade^through grade 9 performance ot)jeC<^es published by the^Michigan Department of 
Educatro^i. Twentyof^ grades 7-9»read]ng perfornnance-objectiveb were chosen for use in item writing, and 71 
out of 155 math^m^ics^obj'ectives were selected to be'measured first. The mathematics objectivesW^re chosen 
^ by represgm^ves of the Michigan Council of Teachers of Mathematics. 

'^Another State Board of Education recommendation expressed'in 1975 stated that tJie Board should expand 
Its efforts in developing ttle'afiective domain and>providfe hurrtanistic edycatron for the state's studdnts\A 
commission has been appointed to draft affective domain objectives for grades K-9. Staff members 6f tfW 
Michigan Department of Educatioft are studyijgihe affective dimension of the existing performance objectives 
and ye investigating new affective measufl^ril^ • * , ^ 



Pfcan&ter Revision of Objectives ^ ^ * • : ^ ^ ^ '\ 

Only a portion.of ?ne ^erforfnance ot;jecfivb? asloplGd Dy trie l^ichtgar> State Board of Education has been - 
rnefisLired ?p th^ assess^^renl pfograni, scrthat Michigan nc^w i^^n the process ot refining, clarifying, an'd revising ^ 
.13 or;]ev;ives:a{htir.;har d^vo^iDo.f-^ f)t*w 6neA'/^Kf;e|'>iTrbject!vc's foT grade. 12'to b*e ptfot-te'stecj in the luture/ V" ^ 
The pn)cess (5f rev<sing the-^bject^ves jcnt eflort of Wie Michigan EouqatJonal Asses5mer\t*Program and the 
In'^tr jctioncifbpeciajisf proy^arH f !^P).of the General EduCsllion Servw;es' with primary r(^sponsibii<ty assigned to 
iSP Plans for, ref vo^^ are statea^n<i te;italive. lotig-zange plqn 1or fho Michigan AssessRtent Programs which is ^ 
being consicfered by Michigan's State Bdard ot E'ducarron The plan contains several steps^and involved large 
* nuniDers of Mtdiigar educators Since the'p'cifi is^stiH lO the discussion stage,' sufffce ij to say, in geweral terms: a 
th ,^ constitutes a'large m^aikeviewot perfofmance gJ^jectiweb lu particular subject arec'is directed;to teachers of 
•r)p o.uoject»areas^ Tne coi^iments of those worKing'with jow dunit'vers and minority students will ;eceive special ' 
a^ttertjon T4ie conir^'eri^:-^ w II be '-ev^ewed by a general revii- VjjroM P and specialised review groups with broad 
rp,Dre§e^na!ion cimo'\Q professional and^lav people. Oralis ot "revised" obiectives wilLbe pfeparc^d by JSP {oi the 
Supei^^it^ngeni of PVib-tc insUucliori and^he State Bturd of Edijc^lio _ . * ' ' 




Table 4 ind^^cateo thn (Vio3^ ret^^r t sle'ps taKt^"i bv Connecticut Florida, and Michigan tor tfie preparation or 
i^^y.S'onv ;>''t(jrmaf^co cbfecnves 




V 



Thp dCv'eioprrH^nt 0} reU i^lstrumtinLS to measurerthe ^ertocmance objectives establishj^by ttu? three states is 
tht; next fopiu in §eciiO'' ill . ' ' ^ \ ' / * ^' ) 



/ 



' T/w \of)g Rtinge Plan ft>r it)€fi^ithiMf!tducational Assessment Pfbgram (L-ansing '[^partment of EdOcaitiin.- 1^4),,< 

ERIC ; , . 



Table 4 



* * y 



Recent Plans for the Preparatiorjf or Revision of Petforniance Objeclives 



The mSjOnty ot the objectives for 
the state's asse'ssmeat' program, 
wiH be selected by Connectlcu^ 
teachers gad subjjeCt-^frea special- 
ists from, a co?tvr)erciarsi3urce.,A 
few NAEP .objectives will be used 
,to permifpgrnparisons with previ- 
pus-assessm^nt programs.' ; 



FLORIDA 



An advisory. can^mittQ^ with repre- 
sentation favoring^ rjon^ducators 
,will identify essential terminal skills 
every p^p<l should master. ' ' 

Thenerminal sWIls ^jil be analyzed 
by subject area specialrsts to de- 
stermine the pariicufar proficiencies 
needed to a^^quire them, r \ 

Objectives will be worded as gen- 
eral skills statements rather than In 
specific terms, accompanied by 
the maximum and mjnimum limits 
of what IS expected at each grade 
level ' - . 

Local committees in each district 
w^ll verify the objectives. 

final^jective's wi|i be adopted by 
the State'Board of Education for a 
'three-year peri9d to provide 
stability to the state assessrhent 
af^d-to altow djstwcts.^me to give 
instruction in these skills , ^ # 

A review process will .be estab- 
lished to keep the objectives cur-' 
rent. * > • 



MICHIGAN 



An apjDointed *eommittee is draft- 
ing affectiv© domain objectives for 
grades K-9. ; , \ 

Per/ormance objectives are being, 
developed for 1welfth-gr^^ pilot 
testing.^ , " * 

A field testmg program has been 
initiated In which teachers 
vofunteer to^jse'the objectives for 
/alidation purposes. 

Centracts Were issued to the Michi- 
gan CounciKof Teachers of Mathe- 
matics ancMhe-Michi^ Reading 
Association to obtain their recom- 
mendations for improving the qual- 
ity^of the objectives and the as- 
sessment-program. * ^ ^ 

A tentative plan for revising objec- 
tives involves a large maii/evlew'-^of 
obfectives ^i'n particular ^bject 
areas directed to te^h^s of Jhe, 
sutjject areas. Comnierits of tea-' 
cher$ working. With low'.achievers 
a/id n^n^ority^ groups^wjlL receive 
special atte^rUiont A general review, 
group' with yvlde lay and prbfes- 
^sjooal, representatiori and special- 
ized^ groups^ composed of .profe$- 
sioD^r^taff and some lay persons 
will^r&View the analysis of the mail 
sur^y, A draft. will be prepared of 
fh'e objectives, taking jnio account 
this -review flroups' comments, The 
drift will besubmittecJHoIhe Siate 
Bo^r^of Education for apprcimaL ^ ♦ 




^ f Deyelopmentijf Assessrrient Test' Instruments by . 
' Connecticut; Florida and Michigan - ' 

* * • . Intfoductioft ; ' 

Most of the states fn tne country 'eriier .ntt) coHtracttng'for ihe acquisition of test items, pacticulariy for a 
6eglnnrng assessment when time presS^e fs involved, facilities and staff are limited, or large numters of students 
are MjTticipa^ng lo the assessment-'Sources'of test jtefns incKjde commercial teeing companies, university- 
' baseyresearch centers, private r>Ofiprofrt organizations, af)6 prfvate'devetopmenl centers. National Assessment 
for tduca'tional Progress (N AEP)' supplies test it^ms Without cost. Scpie states have developed their. own items 
wtth the help of ioeai teachers find subject matter specialists, but usually la such instances the items are the 
property of the'^tate and are protected Dy a copyright, as in the case of Florda and,Michigan. Florida maintains 
that It was.thp first stale to construct ob|ectJve-refe?enced tests of its own \o measure perfbrmaficepbjectives in 
a statewide assessment program ' . ' . 

When a state ^n.tially chooses to develop its own test it^ms fpr an assessment , the items generally are Selected : 
wj!ti ?he^elp of a contracted f^rm from'ex.sting items that have been tesied for validity, are consonant with the- 
sf^tQ's objectives, and are adaptable for use in the state's parjicuiar'assessment program Testjtems for use in 
fater assessments tnen may be wntten by the state's educators m-faining sessions.- with assistance from 
aepartrrenhof educanon specialists, and commerc3^l firm sj^ecia^jsts. Through thtsprocess, pools' of items 
DuHt up. tr;Qd out. and revised until a final version IS formulated . - "^1. 

Both norm-referenced and obiecfive;;reterenced tests are used to measure a state's bbiecfives.'The former' 
have been available fof a good many years from various pubiisber^^ m roceni yea^s, several major publishers' ' 
nave be^ distributing objective-referenced tests, Connecticut and Florida have u^d objective-referenced tests 
tropi the onset of their assessment pcogranr^s Michigan began thar prograrti wrth hprm-re(erenced tests and 
i/sed them for tne fir^t four years. Object ive-referenced.testing was ^tarlecft)y -Michigan f©^ the first timd lathe 
'*1973-74asse$sm^t program.. ^ : ' . ^* , - ^ . ' ^ 

Tabfe i includes the many sources and 'groups that have beenmvolved in th8'devek)pment and^selecttori of 
testjtefttsmConr^t.cut, Florida, ahd Mtctiigan . , " ' 



Table 5 * • . . 

Soui'ces ancJ-Groups InvplvejJ in th^-Oevelopment of Test Instrumenta 



CONNECTICUT 



,ec;3rea3C)eca sis ^ 



FLORJDA- , 



Ce'^rer for ine SUjcfy of Eyaluafion 
Ot' the Of HV9-s^ty 04* C3<itorr.?a' - 

' Srate readmg (jonsultant- 

HarcoLJ't Brace Jcya''>ov'cn'^ 

Educai onat "^est'og Service . - 

vVa5^^^'".g^0use Lea'rnmg Corpbra- 
t>on 



^ ew groups of Florida university 
-puDiiC school teachers. QOE 
,S!aff,a'>d lay persors 

-Local school districts 

-rianda State Univ^Sity , 

National Assess^nenl for Educa- 
ticnai Progress^ (NAEP) 



MICHIGAN 



DOE staff ' 

EducatJCHial Testm^Seryiee 

GaliformS Test Byreau/.McGraw- 
Kiil \ ' . ' ^ \ 

Measurement Research Center 

Annerican Institute for Research -* 

!ten\panels of Mich-gan'teachers, 
university profeesors. school coun- 
selors and (Dsychofog'sis, arxi DOE 
staff .^cufff^fum' specialists -for 
eachsubjecTmfea 

Local school distr<cts 

• Prpfessional organizations in .other 
subject 'areas 

in the futurer Michigan plans to tap* 
rthe resources of educa4ors m other, 
states. NAEP. commerciai pub- 
^♦shefs, afMi ifKiepeft^ef^i «~!esl- 
wnter§ for collecling a lar.ge pool of 
Items • . 



A 



'Fo'f -he f'rst'assessrrrent u^de'-take''^' e^*-^ o'^'^e tnree s;ales Connec! cut usea NAEP reieasea 'OS* 'tems ^ 
x-ca convacied ^or ?es*. V.e^s ^ron?- ir'e^ienter for ih? Study c?^£va=ua^ ai UCLA, and/-^*chrgan's '/rs; lest 



-.-Fo'f 

P.. 

♦er^s 'A-ere Suppi^ed by a comprierQai ^-rrp warKirO A-J^an aa ^occorr!'7^i!tee composed of Michigan educators 
a^o pa?e'r^ls . As ine stages gane^ exp.erTi^e^cvertne years :t]?-rnernaos used by-Ronaa^arTq f/to^gan-V f?:^ 

"p'^epa'atj.on *est •te'^s encof^cfassed .*he-se''vices of ^n^-" ow-n ediica^ors either- from me local school d-s^'Cis 
a'-ct-nr/e'Siiies c*- bcru Cor^neci-Ci^ s u:; ceg '^g :o ^vo^ve 'h^zsiate^ :eachers tnt'ne se'eci.c^ ^es: 
♦e^s "^he ^ik)V.^ng narra^5Ce,de"5CM:es in mce d»2!3.! ^ne m'elhods f'j:b'//ea 07 each'af the tn-'ee states- jn tne 

•a%,'6!0pc^.ent o* les? -terns Taoles 6. 7 a':a 8 inc'caie 'he J^-nds of tes^s used and the sobjo:: arc as a^^o grade 
'even's assessed tne tnree states au^;cg eacf /ea-- ot *ne r^assessn^ePv D'^oorams 



ConhecticuhJest Instruments-^ 
First fieadirtg Assessment ' -s J 

'-'C^^ir.nc S^ste-^s f.S'S} 0* Pt^raoe c^-a 'CMne . 
' 'sv.--;3 r^a 'ea«:i/^g assessr-enf gi/en r Feo'ua^/ c* ''972 ^ orcie- tc pe-^-t co^.pSr sons by age se< an^ 
c:--.,-^*v s.ze a staie. ^g^c^a'^ ara na:.ora. basoire Co-'^ectc^* ^eadng assess^e^* '.sea a^^.-'acie 
r*^-".^e^ tsa^.dacp>^cabre prooecu'es developed c> N^i.qn* AssesSme'": T*^e^est'ten^sv/ere selected t:> iSIS 
r -^Gcpe-a: O'" A*'thjne Deparme'^* of E'^uCat-o" sta^' 

: ' ' • . s ■ 

Matching with NAEP ffems - ■ . - _ " 

r Ncver^ce^ 197:. S'at ona. Ass^sment ^e'eased iSlS app^CK r-.aie:y 220 ofthe reading e/ercises ihat- 
' Ae-e gc^gts ce d'Sdosec tc tne puDic -n ^^av or June.o* 197-2 S.x cr-^e'-a ^or sefpct»ng the ♦est^^emg-wece 
* es;ao> s'^ea \^ o'de^ ers^-e -^axmum compa-abJ' 1/ between Cch^ect t^^i ? -es: jnstrumePTs and P'ocedures 
a^'d r-ose ct Nat .oral Assessme^* The cr-^e^a were 

- ^ ' "'he CG^'e^-* a^a * '^^ a' cwed ■'o'' ret.iv'-^g *o each qi.es: on n the^^-A'EP exercs^es used t^e asscssn-ent 
^0' ce a '.e-'eG ^ - 

2 'ne*c*a ac-^ r-lS:'a^S'^ *'ne ^of- any c'^e *e^ Dac^age Aould no* be nriore ;han 50 r^n.utes 

- , 3-''*e^s Ao-ja be cncse'^' ''o reo*:ese": a ' o* C'.^r>eci-cul^s :eac!'ng goals as 'a' a? possible 

.*er-s of^Otve^se dt^^c^'ty leveis wo<-'a di' seiecte:^ .r the same deq'-ee^as thi^y appeareo r'tne ^AEP 
" ~ 'e-e^se t*e"?s • ' * ^ * 



5 The '^u^De^ o' q^ies-c^s each les; package-wouid oe kert between 19^ana 22 

6 Exerc :>es that "i'e^e su'"tabterc''g''oup admn'SW«t!ori only would be osed *^ ^ - 



ISlS deveicD'ea tn« assessment instruments separately for each^ag^ group- (9. 12. ard IZ1 As a ^.rst step, all 
y 'ne NAEP -e^eased terns vNtre i sted w4h i^e Connecticut objectives tncicated. the aaministratjon r-rr-e aligned, 
ar a ^ne NAEP aiffjcuity level assigned Other'NAEP items were ^dentifi^ocj whith used the same tex* v/'th different 
G-jest'Ons so that two exercises w;^ith Uie^me text would not be used fR the same package. 

• ' One of Co^^necticut's fjye OD,ectiv^s could not be measured by anyjDf the .released -terns ar^jWas not 

• assessed 0^ the remafn»ng four obiecflves, jest f'ems for twcol them wef^TseidorrT found bOt itenris tor tfte oUier 
:/;c A'ere rnore abundant Accordingly, a/f^jf \\\^ fV.u't'P^e choice items that were seldom fdlind *or tnt two 
v3bjectiveb-were fe^ected, and a choice ^vas niaae on^'y from me items that aopea^ed frequentry for tne othe^ two 
obrect^v^ 



• 9eocn on the Assessment of ReaOiCg Sktk of Connecticut Pdi?i'C School Students (Phtiadelphia Institute for the.S^udy of lnqu*r»ng 
Systems) . p 5 , • * ' ' # • , 

33. . ' -' • " 
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Table 6. ^ 



Subject Areas and Grade Levels Assessed and Types of Test Instruments Used By Connecticut 



Date 



Feo'-^.a-) 1972 
Fec^f^ary. 1975* 

Fa- 1975 



Subject Ar^a s 



Reading, 
ne'ao i'-Q 



^^^es 9, 13. 17 



Ag^/Grade Le^l 




Agfe5 9 T3, 17 



Age 13 



Type of Tes 



Objective-referenced, multiple" choice, 
adapted from NAEP exerc 

Objectrve-referenced: rpdltipls. choice: 
some open-ended, mo^t adapted from ' 
NAEP,exerc}ses, and a few from 
commercial sources 

Objective-referenCecJ, multiple choice, . • 
sorrie open-ended, most from commercial 
sources, -a few aaapted from RAEP 
exercises • ' ' ' 



'•Doe to ■.r^cerlajn*'es .of federa' fancJmg 'n fY 1973 and fate Dudget approval for FY 1974 dy Congress tn December 1973 
Connect'cu* $ planned second yea; ot-assessnr^ent for 1973 was postponed until 1975 



Table 7 



Subject Areas aod Grade Levej^ /Assessed and Types of Test Instruments Used By Florida 





— " s — r 

' Date ' 


1 \ 

- - -Subject lArea- 


-Age/ Grade levBl 

< 


i Type of Test ' 


/ 




Beaa^ng ; 


Grades.2,4 


Objective-referenced, mostly multiple . 


1972 

^ 

^ebruB-y-Ma'-ciy. 




' '(Ages 7,9) 


chorc§. but some free responses ' - 




' .Read'na ^nl'ng. 


X3rades3. 5. 9 


ObjBcttve-r'eferenced. multiple chofce. wth 






maXneTia^tics . 


(Ages 8. 11. 14)\ ^ 


v^some supply and construction Jterps 


» 


FeDruary-M3«cV 


Reaoing, wftting. 
mathematics 


Grades 3, 6. 9 ' 


Objective-referenced, multiply choice : 






Science 


Grades 6.9 


\)b|ectjve-referenced; pnultiple choice 




.Febfoary. 1975 


' Reading. v\^ril!pg, 
Vnathe[natics • 


Grades 3.6 


Objectiv^Treferenced, multiple choiCe 
' * * 




October. 197S 


Reading, wrttmg, 
rriathematics 


Grades 3,6 .* 


Obt^ive-referenced; multiple choice 






ffSadirig 


Grade 5 ' • . 


Norm-referencedL • / .• 


« 


t " , \ • 


^ ^ 







Note FkXKJa atso condi^tpc*.«n NAEP-maiched asscssrr^ent in reading and rp^hematics fof 9-. 13-, and 17-^f-<?|^ during' 1974-75 ' 
40 that^tat^pertofimance could compared wim national and regional pertormance if> accordance witfvlhe <^ecttve tn the amended ' 
^^x^jftMmf Act. Testmg too*^ place m. December. 1974. for age 13. »n January. 1975. for «ge'9; ^d in March 1975. for age 17 
NAEk dt)i#ot?veHWarefK)«d test (lero ¥^9fe u ... * » * . v • ^ 



^ dt)j#o^?v^^enc«d t 

1 

. ..V .X^.:., 

ERIC . . 
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Tables /• . - 

SiAject Areas and Grade Levels Assessed and Types of Test Instruments Used By Michigfan 



r-7 » -1- 

Date 


. Subject Area 


Age /Grade Level / 


Type of Test 


January. 1970 (1969- 
70) ' 


Vocabulary, reading, 
English expression; 
mathematics; attitude 


Grades 4. 7 


Tslorm-refefenced; multiple choice 


January. 1971 (1970- " 
•71) 


Vocabulary: reading; 
mechanics of^ritten 
English, mathematics, 
attifude 


Grades 4.7 

y 


Norm-referenced; multiple choice 


* -January. 1972 (1971- 


Word rBlafronships. 
reading, mechanics of 
written English;, 
mathematics 


Grades 4. 7 


Norm-referenced; multiple chqice: 

• 


January. 1973 (1972- 
7 3^ ' . * 


Word relationst^ips. 
* reading; mechanics , 
of written English. ^ ' 
nrtathematics 


Grades 4,7 


Norm-referenced- multiple choice 


September-October, 
1973. ( 1973-74 )■• 


Reading; mathematics; 
word relationships; 
attjtude (optional) 


Grades 4, 7 


Objective-referenced; multiple choice: 
attitude anonymous group measures 


• September-October. 
'<974' (1974-75r ' 


Mathematics, reading 


Grades 4. 7 


Objective referenced, multiple choice . 


c 


Word relatic5nships 
(optTonal) 


Grades 4. 7 , 


Norm-referenced; multiple choice 


• 


Attitude^. (optional) 


Grade$ 4, 7 


Anonymous group measures 


• 


Pre-pnmary in 
cognitive, affective, 
psychomotor domains 


Grade 1 (pilot) 


Objective-referenced; most items' 
open-ended: some group and some 
indivijdually administered in sampling 
of schools 




Science; math^fjiatics 


Grades 4,7 
(tryout) 


Objective-referenced; not for 
reportin§ student results; used in 
sampling of schools 


Spring, 1975 


Readmg; rhathematics 


-Orade 10 
(pretest) 


Objective-referenced 


September-October. 
. 1975 n975-76) 


Reading; mathematics 
• 


Grades 4, 7 


Objective-referenced 

• * 


^ * 


"Pre-primary in 
cognitive, affectwe, 
psychomotor domarns 


Grade X (pilot) 


Objective-referenced; administered to 
sampling of schools 


\ 


Readingum^thematics 


, Grade 10 - 
(pilot) 


Objective-referenced administered to 
a limited number of volunteer higl^i 
schools 




Heading; health; 
mat^iematics 


, Grades 4, 7 
(tryout) ^ 


Objective-referenced; used in a 
sampling of schools 
^ . \ 



35. 



Test Package 

A random serection of the test items w^s made for a test package that took approximately 35 n^inutes of 
administration time, with 15,min6tes nedes^ary for insfructtons. Test items were interchanged as necessary ii^ 
refain a uniform, overall time structure apd to rectify the proper lioi:iald*str*5ut*on of ttie dfllicully ievel. Ther^ we*' 
approximately 20 items m each test package The tests wertf timed, and tape-recorcfed instructions ware 
provided to maximize uniform administration practices throughout the state. * , . / 

Pretesting ' * - 

ISIS hired a staff toronduct a pretest of the administration procedures at six schools, two at each grade-leVfel, 
which were not to participate m the assessment State Board of Education personnel efforts assured cooperation 
Uofr> the districts. The pretest indicated whether the oral and-taped instructions w^re adequate and understood 
by the students angj provided information necessary to prepare training instructions forThe test administrator^. 

Science Assessment \ 

Connecticut's next assessment was conducted in February. 1975, in the subject of sconce. Research 
Triangle Institute was the contractor Again, data were collected on the basis of a probabiJihra^ of 
schools ' . / . K y 

The majority of the test it^rns for the science assessment were adapted from NAEPexercises, but some were 
selected by a committee, ot six local schooi teachers from available published test items. Coi^iecticut is 
Degmning to involve its local educators in tife selection of objectives and test items m order to gam more local 
acceptance of the results of the assessment. The items were field-tested by Research Triangle Institute in North 
Carolina to determine whether the admmrstration procedures were adequate. Most of the test;ltems were 
multiple choice, but a few were open-ended questions There were approximately 25 items to a test, they were 
tinrjed and took about 45 minutesoLadministration time. Tape-recorded instructions were used. 

Alsojncluded \n the 1975 assessment for science was a school questionnaire to obtain demographic data and 
a student questionnaire, designed by a committee of telphers, to determine the pupils' attitudes toward scierfce. 
The questions mainly centered upon the science courses the pupils had taken and how they felt about them. 

Second Reading Assessment • 

At the time of the Connect!C|}t scienpe assessment, a trial testing in reading of all 17-year-t)ld stucfcnts. rather 
than a sampling, was conducted \n one local school to determine whether the results could be used to advantage 
by a specific local community. This trial census testing is to.be enlarged upon in the second reading assessmer^t* 
of a^nlpleof eighth grade students in the fall of 1 975. The census assessment testing will be offered at that time 
to alllocal schools who wish to participate. The Department of Education will supply the schools with the tests 
and provide training in administration procedures^ Local data will not be colfected for .state use, but the local, 
schools will be able to ^\ their local results as well as the state results for* use as a measure of ttie local ' 
performance. 

Most of the test item^ m the. second reading-assessment will be selected by Connecticut ieachers and subject 
area specialists from a commercjal source. Some N AEP items will be used in order to make comparisons with the 
results of the first reading assessment. 



Florida Test Instalments ^ • 
* . * • • * , 

First Assessment 

White responsibility for administering the Rorida State Assessment Program is in the hands of the Evaluation 
Section of the^tate Departrnent' of Education, the development of objectives and test items initially was thfe 
responsibilfty of the Research and Development Section of the Department. Objectives, test items, ,ahd 
assessment procedures for the first assessment in Flonda had to be developed in less than 12 months in ordter to 
meet the deadline imposed by the Educational Accountability Act. To do so. the Research and £)evelopment 
Section contracted with the Center for the Study of Evaluation ^(CSE) of the University of California, at Los 

. - 36 
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Angeles for a catalogue of reading objectives and related objective-referenced test items to measure those 
objectives fmally selected fro/n the catalogue by subje'^t area specialists in theFlorida Department of Education. 

Test Package Format 

QSE arranged the test items into four forms each for grades 2 and 4, prepared administration instructions, and 
delivered all the materials irr camera-ready format. Modification and replacement of some of the items delayed 
delivery for two months. After all the materials were received from CSE, and following State Board of Education 
approval of the test items, the Evaluation Section of the Florida Department of Education prepared pnnting, 
gpecificat^ons and instruction manuals There were 1 16 items for grade 2 objectives and 29t items for grade 4 
objectives Some objectives were measured by two or more ttems, and not all objectives had items prepared for 
them * . • . ^ ^ \ 

Test* Items for each ^rade were divided into four test forms witl^each form .given to a different sampling of > 
students. All.ltems that me^^ured a Single objective were on the same test form. Some itemfe required rriore time 
than others to answer, but each form was designed to take about the same amount of administration time Thus, . 
the number of items of theMest forms for each grade varied slightly Grade 2 test forms had 28, 29, 29, and 30 
Items respectively, grade 4 test forms had 73. 77, 72. sfnd-79 items respectively. Each test form measured 
approxirnately one-quarter of the objectives. The tests wep§ not timed. The second grade forms took about one 
hour; the fourth grade forms took approximately two hours 

Pretesting : - 

Test Items were sent to selected schools for pretesting in the spring of ' 1971 to eliminate ttems that did not 
measure objectives adequately. Assessment procedures also were pretested by 25 grade 2 pupils for the 
purpose of checking instructions and to ^stirhate the time needed for administering a full-scale assessment test. 
A pre-assessment study of multiple-matrix sampling, the method used in the Florida assessments, was done in ^ 
one county Trial versions of the sampling plan also were sent to three school principals to obtain their judgment 
of the adequacy^and clarity of the drrections , - . ' 

Validation ' * ' ^ 

A validation study of the test items was undertaken after the assessment was conducted but before results 
were published. The Florida Department of Education's EvaJuation Section and the state reading consGltant. ^ '^r 
prepared a form on which a review group evaluated the content validity of each item. The review grpup consisted 

of educators from several Florida unjvWsitie^, Department of Education staff, and lay persons. They were asked j 

to determine what items should not be reported in the results because of serious technical difficulties or because ^ 

they did not appear to be a valid measure of an objective As a result of this/eview, the group recommended that ^ 

32 per cent ofihe objectives not be reported^n the results. ^ ^ ' i*^-' 

Sfecon4^sessment ^ ^0} 

More in-state educators were involved in the development of test items for Florida's second assessment in 
1 972-73. Initi&l test itejns were supplied by two local school districts and Florida State University, under contract ^ 
to the Florida Department of Education. All of the reading, writing, and mathematics test items then were 
reviewed by a commercTial testing firm, Harcourt, Brace and Jovanovich, for content validity and appropriateness ' ^j^^. 
for the grade level being assessed. More than 80 per cent of the Items were revised, and another 10 per pent -^^^^^ 
were replaced by the testing firm. Objectives that could not be, measured -becau^ the^^jequired the use of <^ 
unobtainable props, "or because scoring'crjteria had not been developed for, question's requiring written 
responses, also were rdentified by Harcourt,*Brace and Jovanovich. 

Pretesting 

Approximately' 200 students from each grade level participated in pre-test, f5ost-test studies. They werS^ 
conducted to determine tfie reliability of the test instruments on the premise that if the tests were reliable, the 
proportion ot studepts who achieved .success, on the pretest would be comparable to the proportioni^who 
~ achieved success on the posttest..The r^lts indicated that the tests were satisfactory in respect to this premise. 

*' ^- * • , ' ' 

- . ■ . , i% . \ . : 



Test Package Format 

The number of test item? by grade level and by subject areas worked out a$ fqllows: 



Gratfe 


Mathematics 


Reading 


Wridng 


Grade 3 


• 

192 


110 


57 


Grades 


208 


210 


110 

• 


Grade 9 


' J96 .... • 


■ 152 


124 



Three different test forms were prepared for each grade, and all subject areas were included oo each form of 
the test The cover of each form w^s a different color for easy identification of test forms. All third-grade tests 
were printed in colored inks; grades 6 and 9 tests were printed in black ink. A five-digit number was assigned to 
each test booklet which was used to identify a student's responses, rather than his n^e, in analyzing test 
results. The tests were not tirned. Testing time took not mord than 40 minutes for the third grade, 120 minutes for 
the sixth grade, and 1 50 mintlites for the ninth grade. 

„ Validation 

1^* ^ Following test administration, test items-were reviewed by subject area specialists in th6 FI(?rida:Departm.ent 
'Vof B^ucation and by a panel o) Ftorida public school and university teachers. Items the^paneland subject area • 
ij ioecialists considered to be invalid >yere deleted, and therefore no results were reported for (hree third-grade 
; ra:*ifematics objectives. 

Third Assessment 

for the 1973-74 assessment, test items were prepared by Educational Testing Service and Florida subject 
. ^WA^^^ forces. The test forrns were desig^eil and.printed by Educatioiial Testing Sendee. Tiie lest for each 
grad^ was made up into two forms with a differi^nt set of objectives rneasured on each form. The majority of the 
students'iook one form of the test, those m th^ very small schools took both forms of the test. 

For the f.rsl time rn the assessment program, th^ rests were timed at each sitting with what was thought to be 
enough t^me allowed for ail or almost all of^the stu j^nts to complete the questions. Test administrators indicated 
at theend.of \>^e assessment, however, (hat.the frirfte alloted \yas insufficient for some of the questions, and the 
high omissiop late in the responses at the end of each sitting seemed to verify this observation. 

Test Specifications 

. Florida has prepared detaited specifications fd^Vdeveloping their test ijema and for' the, construction of test 
forms. Trte forms have been standardized so th^ they possess uniform administration procedures^, timing, ancj 
. scoring patterns in order to permit com'parison scores aniong the school districts. Specifications also have 
been prepared for ttie field tests. These are too numerous to repeat for ttiis report but can be found in the 
publication. Operating An Objective Referenced' Testing Program: Florida's Approach to LarQe-Scalq 
Assessment. This report is available through tb^ Cooperative Accountability Project.* 

^Urth Assessment . * . 

i/:; Florida is making significant changes \^ its assessment^aftern, beginning with the 1974-75 school year., 
' ' tS^ause the amended Accountability A^i of 1971 requires census testing for the first time; restrictlafor the time ' 
. \tefng assessment^of any other subject areas than reading, writing, and mathematics; and calls for the 
: /cpmparison of state student per<prrnance with national indicators of student perfornrtance. The fourth 
^: '^^sessment was conducted ^n Febftjary, 1975, for grades 3, 6, and 9 iri reading, writing, and mathematics and 
iv,,\^fes contracted with the Westingttbuserlearning Corporation. Each student took athree-to-four hour battery. 

S'^fipudy L. Htynet and 'Cran* wafc^, Openting An Objectiim^fmnoed Testing Progrm: Fk)fid$'s Approach to Lam-Scah ' 
\\fA9em9m9nt iPmm: Cooptrativt ^^OoountibiKty Projict. 1976) . 



Replication of Nattonal Assessment in Reading and Mathemafics 

In addition to the re§(ular statewide assessment of all students in specified gradeS, Florida is complying with 
, the amended AccoyHtability Act ,by x^onducting an assessment matched with the National Assessment of 
Educational Progress so that state^performance can be compared with fiational and southeast regfon ifesutts. A 
sampleof9'-, 13-/and 17-year-oldswilj|Detestedinthesubjectareasotreadingandmathemafics. 

The 1 4-year-olds were tested in Qecember of l974,Hhe 9-year-olds in January, 1975, and the 17-year-ofas^n 
Marph. 1975, a schedule that, parallels NAEP as closely as possiblei^he same test items and testing.time that 
NAEP used were followed in the Flonda assessment. Approximately 80 schools partioipated at each age level, 
and every district participated on at least one age level. Between 20 and 50 students were tested at each school 
in the sample. ' ^ ^ _ \^ '~ ...» * 

Result? Will not be reported by individual student.'school, or district as in the regular assessment program, but 
only at the stale level of performance in the form of percentages of achievement of the objectives and test items. 
The results will be analyzed by cfertain demographic and socioeconohnic categories, such as race, language, sex; 
and Size and type of commtin^y. — — 

Contracting „ 

Florida has continued to contract with a commercial publisher eaqh year of the assessment. The Florida 
Department of EdiJfcation has refiained responsible for supplying ttie first set of test items to the contrgptor for 
'review and mon^tofS al) contract Activities. The Department also prints reports of the results. The contractor 
reviews the test items and takes care of the more technical aspects and activities of the assessment program, 
such as preparing test formats, developing manuals for test administration/ and compiling training matenals. 
Close supervision over all activities is exercised by the Rorida Department of Education staff. The stafthas found 
that personal meetings oq a periodic basis with the contracted firm are more satisfactory and speed up the 
process more successfully than reliance upon telephone and mail contracts. 

^ Flonda contracted with the Westinghouse Learning Corporation for the 1974-75 and 1975-76 assessments. 
Until now, a different commercial firm was Ufeed each year which caused problems because a major effort was 
required on the part of the Department of Education staff in acquainting the new contractor with the state's 
needs in objectiva-referenced testing.Jlorida acknowledges that it wpuld^e more practical and-satisfactory to 
select a contractor for a three-year period, but the state's 45iddrng laws^prevent this kind of arrangement. 
Contracts that cost over $^ 5,000 must go out to competitive bidding with the lowest qualified bidder winning the 
contract. In order to change this procedure, special authorization win have to be acquired. 



Michigan Test Instryments ^ ^ ~~ 

Norm-Referenced Tests 

Michigan's legislation specifically mandated an assessment of all pupils in reading,, mathematics, language 
arts, and/or other general-subject areas of the basic skills. The results of the first ^assessment were demanded by 
a date that preventei^any extensiv^&^evelopment of tests involving much participation by Michigan educators, * 
^---H^wfKeferenced tests were used in'the Michigan Educational Assessment Program,for the first four years- The 
development of performance objectives and objectiv^referenced tests to measure them was being coriducted 
durrng this period, but final versions of the test items were not ready before the 1 973-74 a'jW^ment.' 

For the first assessment. Michigarf contracted with the Educational Testing Sefvice f or \m\ i nfitn i mp nts that 
were the publisher's alternative forms of e?$istihg, standardized, norm-referenced tests in vocat}ulary, reading; 
English expression, andmathematicsifor grades 4 and 7. Specifications for the first assessment were written by 
ETS based upon Michigan ^hool textbooks, A 12rmember Ad Hoc . Battery Specifications Committee^ 
appointed by the Michigan Qepartmint of EcJucation and composed of teachers, superintendents,- adminis- 
trators, research andVcurricalum socialists, parents, and Departrnent of Educatipn staff, reviewed the 
specifications. Department approval followed. . ' 



• Stati budfltt •pprpprlttton* for Irnpltmemifl 



Item Development Panels 

,The EducationalvTesting Service continued to develop norm-referenced tests according to specifications 
approved by tfie Michigan Departraenf of Education for the next three assessments, twiWhe Department was 
jnterested in bringing into the process the expenence and knowledge of the state's educators in order to make 
the tests more appropriate for Michigan studepts. The Department formed six committees or Item Development 
Panels, one for each subject area (reading. rtiathematics, anrfEnglish) at the fourth and seventh grade leveli 
Membership generally consisted of an administrator, tw6 subject area specialists, and fotir classroom teachers 
^ith a strong background m the subjecMiSas:- Recommendations for paneWnembership were solicited from 
several state education associations. ' . ' / ' 

The panel members participated'in workshops dunng which te^t specifications were reviewed and revised 
with the assistance of ETS test specialists and Michigan Department of Education staff. Information was supplied 

* about Item statistics, and direction was given in the technifc|ues of writing test items. Those written by the 
committee members were reviewed and revised ty a test specialist at ETS, keeping in mind such considerations 
as the necessity for one correct answer to an item; simple language, free from ambiguities; appropriateness for 

. the test population; and freedom from racial bias. ' - ... 

Pretesting 

Items that could be revised acceptably were categorized according to content^ijfrd the better items were 
used for pretesting. The pretests were reviewed independently b^ two different test specialists, as well as by the 
editorial staff of ET$. Pretests were administered, along wtth ,the current^assessment tests of basic skilfs, to a 
random sampling of pupils in the fourth and seventh grades. The results' were used to prepare tests for the 
succeeding assessment. , ^ ^ ^ 



Test Format 



All tests wefre evaluated for content validity, reliability, difficulty, and speededness, * Tests for the 1J969-70 
assessment required 10q minute^ of victual working time and 20 minutes to complete a backfground 
questionnaire. For the 1970-71 assessment, iHe.achievement tests were lengthened to pdfmit the reporting of 
reliable scores for individual pupils. The tests tpok 1 15 minutes of working time; the background and attilude 
.questionnaire was hot timed, (n 1&71-72, the^test battery was estimated to take a cor^binedlotal of l lO minutes 
of actual working time. The student background portions and a pretest of the 1872-73 testing took about an 
hour. - , • 



Attitude Tests ,^ 

*• " , ,1 

-Attitude tests have been in and out of the Michigan assessment program. A pupif attitude teit was used in the 
t969-70 and 1970-71 assessments, but attitudes were not measured in the . 3971-72 or 197^73 assessments 
'because the test did not meet Michigan standards for reliability, and the measure was withdrawn forVevision. 
Preliminary attitude tests had been tfted out earlier in the 1971-72 assessment by more than isOO fourth and 
seventh grade pupils in three school districts. From this tryout, two attitude measures -were chosen (attitude 
towdtfUchool and self-conCept) as attitudes th^t could be welPmeasured. measures Jlere given on a 
voluntary basis to grades 4 and 7 in the assessments conducted in the fall of 1973 and the fall of 197^4; however, 
they were omitted in 1975-76 in a search for a more v^lid instrument. * ! , ' 

Objective-Referenced Tests 

The^decisiocMo make the fundamental qftangt to objective-referenced tests was made in ' 971 when the 
Michigan State Board of Education and the State Superintend^t of Public h^truction dfrect(«l the staff to 
develop the assessment tests along with the establishment of performance objectives Vthe basjiC skills areas, ft 
was believed that testing students pn^ objective-refisrenced items based ut>or\ specific, minimal performance 
objectives prepared by Michigan educators and citizens would be a better )way to determine an individual pupirs 
knowledge, and the rfsOlts would-be more useful to local educators for-planning remedial assistance programs. 
In addlHorv, the 1969 Michigan Adi No. 307[ which required the development of a state assessrrenl plan, said 
that the plan should incluole "procedures for the objective measurement of instructional outcome s" among the 
studer>ts. ^ ^ 1 ^ 
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Local School District Gorrtracts for Test Development 

A model was devised in 1971 for developing objective-referenced tests rn which contracts were ayv^frded by. 
competitive bidding to a commercial firm (CTB/McGraw-Hill) and to several local school districts. The school 
disirtet$l>rc5vlded groups of teachers; sub)ect~area*spedaiTslsrand^ad^^ who feeeived from me- 
commercial test publisher special training in developing reading and mathematics test items. A four-day training 
session was held for the test writers of the several districts. Item writing during the training sessron was 
Supervised and monitored by Michigan Department of Education curriculum specialists, assessment program 
staff, and' representatives of the commercial publisher. The items were multiple choice items. Special attention 
Mi/a? pM.to kgepin'g tl:ie.yoQabulary level at4east one gj:ade level below that tot which the items were written and 
%to elifT)inating confusing wording or illustrations, intricate test items, and ambiguitjes. After two mc!)nth§, the 
groups of educators had written appro)gmately 2,000 test items. • . ^ 

Pretesting 

Preliminary item reviews were conducted by Michigan Department of Education staff, selected item writers, 
and local school district project directors. The Items then were reviewed by McGraw-Hill for clarity, 
appropriateness, vocabulary TevQl, and correct measurement of the objective. The five best items for each 
objective were edited and arranged in a forrriat-for pretesting. * ' V 

The pretesting was conducted in the school districts under contract forjesrf development and in the Detroit 
Public Schools, grades 3, 4, 6, Jand 7. Terminal grade 3 objectives were nrj sasured by grades 3 and 4; tojhinal 
grade 6 objectives by grades 6 and 7. Meetings were held beforehand witf* the teachers involved to discuss the 
purpose of the pretest. . . , - * 

. Following the pretest, teachers' opthions were sought concerning. thie teSjjis. Ttieir comments were submitted 
to panels of reading and mathematics specialist^ for further reaction. The performance objectives and tests were 
reviewed item by item by the subject area spectalists.^and thetr.recommendajions were considered when the final 
Items were revised for use in the 1973-74 assessment which aimed to rrfeasiJe rrlinimal skills objectives desirable 
for all students to attain. The test development process^, including the piloyfe$t and up to the final version of the 
test, took apprdximately nine months to complete. ) ' ^ ^ 

The developrneglgji new first. grade objective-referenced instrumen^as begun in 1973. Educators in four 
local schoor districts wrote tKeV^st items under*^fhe direction oflhe Itlcrt^fift Department of Education staff. 
They were reviewed and edited by the American Institute for Research ift Pajo Alto and then tried putm thefour ^ 
local school distncts. FollowingVeviews and revisions by panels of teachers and specialists, the firial instrunrrent 
was prepared by the contractor according to specifications approved-bylhe Michigan Department of Education 
for pitdiuse^n the 1974-75 assessment program. ^ 

1973- 74 Assessment ^ 

MeasuremeAt Research Center and Westinghouse Learning Corporation assisted the Michigan Department of 

Education with the 1973-74 assessmerit in which the objective-referenced tests were used for the first time.' The 

^ade 4 tests measured 23 p^rformance objectives in reading cwd35 perform^ce objective^ in mathematics. 

Grade 7 tests measured 23 r'eading and 45 mathematics performance objectives. There were five test items for 

'each objective jn each of.the tests for both grades. All the pupils rn grades 4 and 7 took the tesJs. The reading 

and mathematics tests were not timid. The word relationships tests, also admiriistered in this assessment, was 

timed, but generally the students could complete the three tests in two to four hours. The attitude test was^ 

offered on an optional basis. 

, - ^ m ^ . 

Beginning with the 1973-74 objecfive-i;efferenced.testing,'the Michigan assessmeht has been adovnistered in 
September-October rather than in January of each yea>. It was decided to collect information from the 
assessftient ih the fall of the year so that teachers in the local 'districts couW receive the tSsyjts.early enough to 
prpvide remedial assistance to students requiring it. " * ' ^ ^ 

1974- 75 Assessment . ' / 

The M^surement Research Center was the firm ctjosen to handle printmg and sconng fpr^¥l 974-75 - 
assessment. Based on th* results of the 1973-74 assessment, subject matter Specialists defeted some' of the 



^gradft4,and V objectives and test items -used in that assessment and clarified others by word changes or 
improvements in the illustrations. • ■ ' ' ' 

Testirrg of all pupils in grades 4 and 7 on a core of* mmirtial performance^ objectives in reading and 

* niathOTatics W5S cpnducted again in the 1974-75 assessment program, but 4 slightlyMewer mirnber of 
Objectives, were measured this year than in the previous year. Thirty objectives were measured for grade 4 
mathematics; 19 objectives for fourth grade reading. For grade 7, there were 40 objectives measured in 
m'athertiatics and 20 gbjectives in reading. As in 1973-74; five test items measu;ed each objective ih each test 
for both grades. The tests Were not timed, but in 1974-75 both the word relationships test and' the attitude test 

* wereolfered onah optional bas'is. " 

Some special features were introduced in the 1974-75 Michigan assessment. New, experimental objective- 
referenced items in science and mathematics were administered to the fourth and seventh grades on a school 
sampling basis. All of the students in the designated schools received the extra questions.'Thirty minutes of 
Additional time were needed to complete the tests with the experimental items. The purpose of the tryout was to 
father esseritial data on the psychometric properties of the test items and to select items for future testing. Data 
for reporting'statewide and individual pupil results^on the attainment of the objectives W6re not gathered. 

The new test items were written as part of a cooperative project between the'Michigah Department of 
E^iwca^ion and nearly 30 local school districts. T^edistncts are aiding the Department of Education in building a 
.fi^e.of tesf items for further use both in the state assessment program and in the tocal needs assessment 
pIfograms , ^ ' ^ . 



•^Another special feature'of the 1974-75 assessment was the first grade pilot assessment. A sampling ot 
Michigan schools which enrolled first grade pupils. was assessed with the revised pretests used in the ^1973-74 

^ assessment to measure the Qognitive, affective, an'd psychomotor domains. Forty-four separate tests measured 
48 of the pre-primary objectives approved by the Michigan State Bo^rd of^Educationr No teachfer gave nrore^ 
than one test covering nomore than two objectives because of the additional time needed to administer the test* 

Mo .j5upils of this young age. Some tests were at^ministered. to small groups and some we^e^ individua«lly 
administered'. The tests were not timed, and a single test administration of any small group could be completed 
within 20 minutes. A single lest administration of any individually administe^d test, could be finished in five 
minutes . ■ ' ' , . . . 

■ Test results provided reliable data for improving the test it^ms and assessmerit procedures for later use; for 
determining educational needs^s reflected by Ihe pre-primary objectives; and for revising the objectives: 

1975-76. Assessment ' ' ^ , ^ 

. ' ^' 

The core testing of every pupH in grades 4 and 7 ih readir^g and mathematics was repeated in the 1975-76 
assessment with the same numbej^r of minimal performance objectives that were tested in the previous year. 
Experimental test items again were tried out, in grades 4 and 7 on -a school sampling basis m readfng, 
m'atbematfcs, apb in a third subject area, health! Results are to be collected at the^state level and will bemused for. 
the selection of items for future assessment tests. 

^ * X . ' ' ] ^ , ^ 

The<first grade pilot assessment again was> administered in a statewide sampling of schooJs under the^me- 
procedures as in 1974-75 except that 32 objectives, instead of 48, were measured in 1 975-76. ' . 

Tepth Grade Pilot As^sment s 

, X pew feature of the Michigan Assessment Program in J975-76 is the grade 10 pilot assessment. The* test 

itehis were written by teachers and specialists provided by four Michigan school districts!" Following a review and 

selection process, the technical support contractor assembled Ihe items in bobklets \vhich then were tried out in 

the same four local districts in the spring of 1975. The contractor processed the resulting jdata and prepared the 

test booklets which were used on a pilot basis in the 1975-76 assessment program." 
/ ^ _ * . ' - — ' 

. A group of 30 volunteer high schools were stratified according to the size of their tenth grade enroUmentS and 
district, achievement: level (depending on the seventh grade atfainmen4 resists of .thd 1974-75 reading 
assessment) . All tenth grdde- students in the 30 volunteer high schools participated. Appro)dm^tety 100 ' 
objectives were divided into four tests consisting of multiple* choice test items. No more than 210 minutes were 
needed by a student to complete the test, , ' . * / 



The tenth grade assessmefii is the firsf "to |pe administered at the high school level in the Michigan EddQatipnai 
Ass.essmen't Program. The proyam will fo6u6 on informing tfie school staff about the assessment prograrry, 
trying out t^st admir«stration procedures, and explaining thauses of objective-referenced testing results. ^ 

Tentattve Plans for the Future Development of ObjectWe-Refemnc^4 Test W4nW^ ^ . ^ 

Although future plans<for developing test items in Michigan' still are in. this' discussion stage and do not have 

aJ approval from the State Board of Education at this time, a arystematic plan is being devised. Beginning with 

the use. of objective-referenced tests in 1970-74, the assessment itetnshave been written entirely Michigan 

educators. In order to avoid limiting the scope of the itepis, Michlgar> is considering "a plan for collecting a large, 

usable pool of iterhs from several sources,-^s well as those written by Mtchigan educators; Other souroes woulcj ;. 

be educators of -other states. National ^sfeessment^f Educational Progress,- commercial pu6lishers, and'^ 

independent writers. / - -r' '-A* 

* "i 

* Item reviewers, the majprity^of whom are to be Michigan educators, will be sought from all major geei^aphiC . 
regions of the state and>i[l represent large minority groups within the state and'areas &f vaj-^ing population 
concentration. Particular attention will be paid to reviewers who have worked with /ow achieving students. The 
. Midhigan Department of Education staff, in cooperation with teams composed of two or thi;6e subject matter 
specialfsts and a measurement specialist, will review each item according to several erit^ri^^aind eliminate those 
Items which cannot be corrected satisfactorily: .''"^ 

* ' Following this initial review oj the test Items, the items will be tried out 'in a small grasMp (^'Jstudents to Obtain 
tfiejr, Individual reactions. There can be more^han one of these jnfqrnf^tryou'ts, rangfhg "frdm a: smairgroup^)f 
pupHs to several classes of students. More formal tryouts can take pl'ac;0fy adding eXperfm^iltal te^t ltems4o the 
regular assessmerjt instruments. Those itefTns that prove to be difficult'^br are negativ|gly i^ias^^d in the formal 
tryout will be reviewed a second time for revision dr elimination. This systeri^ of tryouti and;-evfew procedures is 
expected to yield a final pool of usable items from which a selection 0\ '^\ items can be fnade lor any gliCn 
assessment. • ^ * , ' ' 

Most of Michigan's festitems have been multiple ohoice, but the item writers will be entourage to devise free 
response, open-^nded types of items as well, or whatever kinds of items appea^ to be>most appropriate for 
measuring a particular objective. ^ '' ^ ' , • 

' Michigan expect^ to expand its assessment program staff and fe^ls that ^-he tr youta^ould be handled dir eotl^^ 
by the staff, although the use.df a contracted firm or both the staff and a firm i$ likely for th5 present.* > 

•The principal steps taken by the three states in the development of their test instruments are briefly 
. summVtzedinTableQ/ ' v * ^ ..'^ * 

: / ^ ^ 

• * T^e Long Rang& Ptan for the Michigan Educational Assessment Program (Lansing; Department of Education. 1974) pp 15-24 




/ • ' , Table 9 • • , • • 

Current Methods Used by Connecticut, Florida, and Michigan for the Development 

^ of Test Instruments / . . 



, CorHiecticut 



Florida 



Michigan 



Some NAEP tesbexercisee 
used, but the majority of 
Connecticut's test items will be 
selectecUfrom commercial sources 
^by Connecticut teachers and 
reading specialists in the future 

"Commercial firm conducts a 
p/etest of the it6ms 



Initial rtem§are slipplied by the 
state university andjsevQral tocal 
districts undef contract to the 
DOE 

Test ttfifTis selected according to 
tes4 specifications standardized 
for uniformity to permit 
comparison of scores among 
'School distncts 

Commercial firm re>?ifews and 
revises items , 

Pretest cdnducted to test 
r^iability of instrgments 

Valid'ation of test items takes 
place following assessment; ' 
invalid test items not reported irv 
results ^ ' ' 1^ vj»>^5 

Some NAEP itfems used in 
replication of NAEP assessment 
,for a sample of 9-, 13-vahd 17- 
year-olds during 1974-75, apart , 
from the regular assessment 



* Initial t«st items prepared by 
teachers, subject^areg specialists, 

' and administrators of several local . 
school districts under contract to 
DOE • . • • 

^ * 

Training sessions held by . 
commercial firm and DOE , 

Pr;eliminary item reviews 
conducted by DOE staff, selected 
Item writers, and toc^l district 
project directors ^ « 

Jtems reviewed by commercial 
firm ' , 

Tryoutsj'conduded in districts 
under contract to write it^gis 

Teachers'^pinions sought 
concerning the items tried out in* 
these districts 

Subject aceli specialists review 
teachers' commerTt's andahe 
itiems for preparation of final 
item^ 

Proposed future plians consist of 
a l^rge pool of items from in-state 
and put-pf-state sources* Reviews 
will be perfocrned first by: ' ' / ^ 
Michigan educafors representing •* 
major geographic areas, minority 
groups, low achievers, ttiert by 
DOE staff, subject matter 
•Specialists, an^d a measurement 
specialist according to set * 
criteria. Final items will be 
selected from informal and formaf 
try outs. ' 



Use of Retateicl Data and Variables by Connecticut, Fidrida*, and Michigan 

Tbe kinds of related data and variably a state plans to cojiect tn arf assessment program depend upon * 
decisions made about th^ ty^ of information wanted from the assessment and -how the results shoulcTbe 
reported, fl9poir<tng resute by catbgoftes^ age^ and/^»grade tevcff aQd* sex is ^he most common prdctfcer 
Con necticuf reported by age level in th^ state's first asses^^nentm order to synchrooize their ^ssessnnent with 
the NalJOftal Assessment ofEducational Progress age levels <9, i3, Snd 17) arKl to compare state results with * 
nationa^^nd the northeast regional results/For the first two yearl'.of the Florida assessment, objective^ were 
adopted for aga^evete 8, 11, and 14, and age in this case was used, to <J^f ine the pupils to be tested in ihe 
sample. Problems arose because it was too difficult for the schools to identify their students by age for toting 
due to the^stAiCture of their stud^t information systems. Therefore, Fkxidft discSf»tinu6d the use of th^age level 
category and defined the testing population by the Correspohding grades t)f 3, 6, and 9; objectives have been 
prepared for grade lev^s since 1973-74, In norr-^graded schools, the pupils to be tested are identified by *)e 
number of years in school. A recent exceptiph to this pobcy was the N AEP-type assessment perform^ in Floffda 
jh 1974-75 (apart frt)m the regulacassessment program) which assessed age levels commensurate with those 
assessed by NAEP to enables cornpartsonbetween state pedormar>ce and national and regional performarice. 
Connecticut andFlorkja report results by se5?rM*cjT^ ' * 

Data on socioeconomic slatus and demographic data have been gathereS by the three states with varied 
degrees of emphasis. Connecticut reports results by community §ize^(b»g cities^ fringe cities, medium and 
smaller cities) ,,again cocnmensurat^with th^ National Assessmenf of Educational Progress, and plans lo collect 
considerable socioeconomic data and schoof resources information in iuture' assessments if the funds are 
available to do so. ConnedficuT hopes^to develop a predictiorv'instrurnent to show the level of student 
performance that may be expected, , '-^ ' ' , ^ , " 

Ffonda uses its, data for special analyles to ve^rify tm representativ/eness of^the sampie and pr^vp^^ 
information for particular research reports.^Florida is beginning topredict local fechool disthct scores andfaftec . 
the 1974-75 testing, school scores will be predieted. Consid^able demographic and socioeconomic data al$o 
wiif be Collected m-Flonda's NAEP-replicateti-assessment which will be^usfed in "reporting the results of the^ 
assessmerit . ' 4 z . \ ' * ^ . - * 

V ^From the Wflp^iing, Mrchigan's assessment has been lied to 'the .premise that student back^ound 
characteristic, the qi)alitjesof.the ir)strujcttonal sfaff, and the amount of financial resources spent by a distnct ' 
tiBve relatlon^psrto actirevemeTTt tevets. Mrct^rgan used-a-studeht^acJcgro^^ the tirstjprr 

years^of the statj^'s assessment' program; a disked for biographical information, eccfijdhDic status, and the 
educatb/iat attainment* of the parents, but th^ questionf^aire wa^ discontinued because it became a 
controversial issue. Later, data for socioeconomic status was estimated , from informatioi^given on 
qijestionnaire filled in by theschod principal, but this method, was considered fnadequate ^nd w^s stoppW. 
Michigan hes continued toother ^ta on aprt^imat^y^t5 mea^res concerned the instru<^ion^Jstaff, 
distnct financiaf resources, per cent of racial-ethnic minority stu0ents, school dropoUt rate, and !Hie*zeof grade' 
levels as^fessed, all of which^re obtained from [>parlfnentt>f£ducatiOnrecords. . 

' " . , • -'S ^ • <<• . 

The Michigan Department of Educ^tipn provided rwrn tables for local school offjcialsip use in mlerpretingj^ 
human and financial resources mformation reported in school and school district surnmaries. In the 19Z4-75^ 
assessment, the variables are variously reported at the state, district, and schoof levels. An optional magnetic 
- tape reporting nr^ethod also is provided to researchers w^o/waQMo investigate the relationships between the 
assessment results other educational variables. ^ - . - 0 . - * 

Tables 10, 1 1, and ^2 give the most current variables gathered by the Connecticut,^ Florida.^ and Michigan, 
thar source, arid the-use of the data., . . " J'- • t 




Table 10 



ielatdd Data and Variables Collected by Connecticut^ 



O^ta Collected 



Occupational and educational 
tevels^ot parents . ^ 

-''SPalues. goals, and interests of 
students • \ • 

Teacher age, level of training, 
experience, salary 

Teacher attitude toward jobs, 
.recognition of merU 

%Pi3pfl/staff ratio." per-pupil costs. 

typesxjf special services, special 
.education data.fiurrTber of library 

books, jinancial resources of 
^c^ommunityr use otedufcational 

nriedia; pupil popj^lation 

StiKjent dropout rate/nu^nber' of 
curriculum option?, vocational ^ ^ 
preparation and fd|low-up%, 

Tjeachrng methods, curriculum' 
and teachng innovations* 



bDfiie information currently 
avaiiaWe.^bul most wouldTfe " 
collected through riew procecJures 



Obtained From 



Use 



To make studies of the 
Tefalidn^?p-;df tf>e^ndnroh " 
variables ;lo pupit performance in 
terms of tfie goals and how.this 
information can be us^ fn 
antiapat^ng pupil performance 

To develop 'a prediction 
instrument which will show the 
level of f)erformanc? that may be 
expected 



•These pre Coonectjcufi at^lK:lp^letj plane fof {he future rf funds are avaitaBie In previous assessnnents Connecticut coUected age, sex. 
and derm^raphic data t>n size of community (t)*g cities, fringe crtie^s, rT>edKim crties. smallp' crttes) m ofder to report and compare 
results by size of community, by state, by northeast region, ariU by r«tKxial resutts as" reported by the ^4atlonat Assessrpen! of 
Educational Progress " ^ ' ' 



Table 11 



mi 



Related Dat^ and Variables Collected by Florida 



7 Data Collected 



Obtained From 



Use 



Date of birth * 

Sex 

Race 

Whether student understands 
.spoKan English 

Whether student is a special edu- 
caiion pupil". ' ' . 

- . . * 
Whether student »s a migrant sto 
dent • " 

Native language of student 'wl^3: 
"doel^ not understand "English 



Test admihistrator in space'provid- 
ed on test bpoWet cover 



"For special' analyses to verify 
representativeness of sample * * 

' For special research reports, such 
as reports of results by categop^ 
of * sex, race, 'socioeducati'cflhal 

•status ' 

To predict scores of distnct and. 
following 1974-7Sasse&ment. to 
predict 6Cores of*schools 
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Tablfe 12 

. Related Data, and Variables Collected ly Michigan ^ 



Data Collected 



- Obtained From 



Use 



HumanlResourc^s: \ - 

Professional instructional staff per 
1.000 pupils 

.Teachers per I.QOO pupils 

Average years teaching expen- 
errce 

Percentage of teachers with 
Master's degree0id above 

Average* contracted salary per 
teacher 

(Above collected at slate, distnct, 
andschooPlevels) 

Dtstnct Financial Resources ' ' 

State equalized valuation per resi- 
dent member 



Department of Education recbrds 



Local revenue per pupil 
State school aid per4>upil 



4' 



K-12 insUyctioneH. expense. per 
pupil • ' 

Elementary instructional expense 
per pupil ^ * 

Total CLxrenl operating expense 
per pupil 

Total operation millage 

(Above tollected at state and^dts- 
trigt level) - a - 

Other; 

Percehtage ot racial-ethnic minori- 
ty stCidents (school, distnct, and 
state level 

School dropout rate (state and 
district leve[s) 

Grade level memt>efship (state, 
district, and school levels) 



Reporfed in school and school dis- 
trict summaries; norm tables pro^ 
vided to local school officials for 
interpretation 

To provide optional reporting 
method to researchers for investi- 
gating relationships between as- 
sessment results and other educa- 
tional vanables ' ^ - ■ 



Which Ruplls fiife Tested and SampHng and/or Census Testing Methods ^ 

^Probability random sampling is the procedure used 6y.Connecticut to select the age groups participating in 
• the ass^ssnrient program: The selection takes place in foyr categories: by community stze. by school district, by 
'SChtkrfsmeach distnct.andbypupits^WTthfn^^ ' * * ------ 

me first three assessments tn Flirida, beginning with the 1971-72 program, followed the multip<?^atrix 
samjiimg method to assess pupils in specified grade levels. When the 1974 Florida General Assembly amended 
tb^vEducational j^ccountability Act c5f J97 1 , this practice was changed- Beginning with the 1974-75 assessment, 
all students in specified grades haveb*en tested so that Florida educators can receive reports of the resutfs for 
tndwTdua^ students anc^for each schoq), as well as on a local <ji$trict and state leve< basis. Florida's NAEP-retated 
assessment, also conducted m 1974-75, resulted m a two-part assessnwent program that year and; in this 
particularfupgrafm, sampling of the specified ages was similar to National Assessment of Educational Progress 
(NAEP) pr^eedur^. ' ^ ' ■ - • • 

T^^e Michigan assessment presently itf evolving mto a two-part program: all pupfis in grades 4 and 7 are teajed 
as u$uai on a core of important minimal objectives, and a statewide matrix sampling nrTethod is operated 
simu taneously for oth.er objectives in- the tryout and pilot portions of the program. Sampling procedures, 
precipitated by the change-over from norm-referenced testing to objective-referenced testing, were introduced 
for the first time in the 1974-75 and 1975-76 assessnnent prografrrs. , 

SakJipling in Michigan w^ performed at the school level only is 1974-75 and in 1975-76. A list of schools was 
drawp up which contained the grades desireQl for the sampling process, and th6 necessary number of units was 
randomly selected from the list. No further sampling was done at the classrbom or student levels. All thestudent#. 
in the desired grades of the schools selected \j\ the sample took the tests. This method was used for the 
experimental items tested in grades 4 and 7 and for the firsj grade pilot assessment both years. The* tenth grade 
pilot assessment in 1975-76 involved al^tenth grade students in 30 schools which voFunteered to participate. 

The Michigan Department of Education staff is planning a new spiral sampling procedure for assessments in 
the future which will result in a statewide sampling pf student^. 

Table 13 notes the number of pupils tested; those included^gfj exempted from the assessment pcogram; and 
the sampling methods Jsed by Connecticut. Florida.^nd Michigan in recent years to select students for testing. 
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- . * Table 13 

Pupils Tested and Sampling and /or Census Testing 



State 



Pupils Tested 



Sampling and/or Census Testing 



CpnnecUcut 
Number tested 



Age /Grade 



Pupii? mcludBd 



Pupils exempted 



r971-72— 7,751 . • ' 

FeDruary/1975 — 4.500 

Fail. 1975-4.000 plus any other locaf 
schools who pl^n to participate ' 

9-. 13-. and ^7-year-oids m 1971-72,, 
and February. 1975. grade 8 only tn falf 
of 1975 

All of the given ages in public and 
vocatbnal-technical ^schools, plus 
those who have dropped behind one 
grade level or are in a grade ahead, 
nonpublic schools ^nduded in 1975 at 
their request ' 

Dropouts. , educationally mentally 
.retarded: emotionally disturbed, and 
non-Englis'h speaking pupils 



A ,^ systematic, 4-sta^e probability 
.random sampling selection was made, 
first stage by community size (big 
cities, fringe cities, medium cities, 
smaller cities) , second stage by school 
district; third stage a selection of 3- 
schools in each selected, distnct. one 
for each grade level; and fourth stage a 
selection of specific pupils taken at 
randorli within each school. 

The required number of -eligible pupils 
in any school was 48. but the final 
Tjumber was set at 60 to allow for 
absences. 



Florida 

* Number- tested , 

Age /Grade 
Pupils tnclud^d * 

Pupils exempted 



1973- 74— 1;I2.000 

1974- 75-^00.000 

Grades 3, 6*and 9 both years 

All of the given grades plus non-English 
speaking and mtgrant pupils 

Educabfe mentally retarded; 4rainabte 
nientally retarded: blmd; deaf; alse 
* ex^mpted on an individual basis are. 
exceptional pupils (with physical or 
emotional problefms) vrfiom the school 
coordinator and principal agree should 
nottie tested ' 



Up through ,1973-74, multiple (patrix 
sampling was used in Florida. Only a 
portion of the pupils' in a school were 
tested, and no pupil took all the items 
on the test. Thejtems were placed on 
three test .forms per gradp^, and each 
student completed only one dt the 
forms* The sampling was designed to 
l>e representative at. the state and 
district levels. _ ' . . 

Beginning in 1974-75. census testing 
•has-been mandated by law in Florida 
for, grades 3 and 6. In 1975«76, all 
pupils in grades -3 through 6 wiirt)e 
tested. 
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. Table 13 (Gontinued) 
Pupils Tested and Sampling and /or Census Testing 





state 


Pupils Tested 


Sampling and /or Census Testing 




7 

Michigan 






• 


Number tested' 

V 

Pupils .ncluded 

- 9 " 


• 

1 973- 74^3 18;006' * 

1974- 75 — 406,000 (there were ap- 
proximately 320,000* 4th and . 7th 
graders. 16.00d nenpuWic 7th graders, 
and 70.000 1st graders) 

1 y / J- / 4 — uraaes 4 and 7 
1974i75— -Grades 1. 4^ar\6 7 

Pupils in specified grade levels, plus 
"those receiving ltlneran^serv^ces (hard 

of hearmg, physically handicapped. 

educable mentally retarded, emotionT 

ally disturbed, those with speech im- 
.pediments) ^ ' 


Census testing used in the core assess- 
ment of grades 4 and 7; samplmg 
procedures, applied at the school level, 
used in the 1974-75 and' 1975-76 as^ 
sessments for experimental items tried 
ou} in grades 4 and 7 and for the first 
grade assessment 

Necessary number of units -was 
randomly sejS5ted from a list of 
schools whicflcontained the specified 
grades; rlo furtner sampling done at the 
classroom or^ sftident levels: all stu- 
ut;ni5> wi int; specwiecj graces oi ine 
school sample took the tests 


• 




Pupils in non-graded programs wno 
.can be identified as 4th and 7th 
graders, those whose grade level can- 
not be determined to be included if 
they are in their 4th or 7th year past 
kin(^ergarten 


Department of Education staff plan- 
ning a new spfrarsampiiog procedure 
for future assessmertts wnich will resUft 
in a statewide sampling of students 




•i 


Tnose-who attend pubifc scfioots on a 
'Shared time basis from nonpublic 
schools provided they are getting in- 
struction in reading and mathematics 
in the'public schools ^ 








Nonpublic first grade students included 
at the opti&n of the local district ^ 


• 




Pupils exempted 


Confirmed Type A menlsflly handi- 
capped unless they participate in regu- 
lar classroom programs and can be 
tested without physical or mental 
strain," those who receive instruction 
only in special classes Excluded at the 
option of the local district <«s^ 

« ' 


"J * 

m 
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Test Administration Procedures 



ERIC 



Introduction 

Test administration demand^/^oonsiderable^cnount of prelimrnary work and careful planning on the part of 
ffie conlraclor and fne s4ate Education agencyBeforettie tests are tianded out to the students and tesltng for the 
assessment program actually begins:P:eople have to be appointed to take charge of.every administrative detail 
linked iq a chain fron^the contractor arfd the department of education down through the districts, to the schools, 
-and tqjj}e-d3[5sroQfri where the tests are given The process is reversed with the return of the tests and m^^terials 
"Jj^nlli^ school back to the district and ultimately to the state education agency, the contractor, or to 

a sconng firm for processing. 

pending upon the number of Students to be tested, the process can engage a substantial group of persons' 
to maR^e local arrangements with the local distncts and schools and to administer the tests, as m the case of 
Flonda an^S^higan. or a smaller team of persons hired and -trained by the contractor', as in the case of 
Connecticut Cb^cticut tested 7,751 students in their first assessment^pnd 4.500 in the second assessment. 
Florida tested 1 12^000 the 1973-74 school year and expects to test 40^0,000 in 1975 to comply with the state law 
which now mandates thelesting of all students hi selected grades Michigan tested over 300,000 students a year 
in the earlier assessments and over 400,000 ip 1 974-75 



The details of the test administration pj^ 
described next 




edures followed by Connecticut. Florida, and Michigan are 



Connecticut Procedures 

Th^ commercial firm cprffracted by Connecticut to handle thej^adihg assessment in -1971-72 was 
responsible for test adjj^tfttstration. The Institute for the SfudV-efihquiring Systems (ISIS) first hired ten field 
administrator^d a^ervisor following personal interviews w^th teachers, principals, and substitute teachers in 
J who were recommended by local district superintendents and other educators. 





Two training sessions, monitored by Departrnent of Education staff, were held fay ISIS for the administrators 
and me supervisor. in4he-f4rst session the participantswere givea an. overview of .the program end instruction in 
the important preliminary wofk to be done prior to actual testing, such as directing a planning ^§sipn with the/ 
school personnel involved,' scheduling of the tests, and how to select the testing facility. The sepc^ci session hel6 
a month later provided training in the actual administration of the tests, thexoding of the te^bookle;s, andyfhe 
Qpreparation of coding transfer forms, 

^ In ordesf to secuce maximum cooperation and understanding from the schools in the sample, several contacts 
were made by mail and telephone before the first meetings were held with the school officials. Six weeks before 
the field administrators' first visits to the schools, a letter was sent to all supenntendents of the schools selected 
for the sample. The letter explained the assessment program and Its relation to the National Assessment of „ 
Edi3cational Progress (NAEP) , a^ked for cooperation, 'and named the schools in the supenn^errdents' districts 
that were to lake'part. Following this mailing, a similar mailing was s§nt to the prir}cipals of the schools m the 
sample, along with detailed explanations and instructions regarding the assessment process. The instructions 
suggested that the assessment would need a program cooKttnator who could be the principal or someone 
appointed by the principal. V — J ^ 

A telephone call was made to each school principal by jhe Connecticut field subervisor to schedule 
appointments between the administrators and the^principals. At these meetings the detaiffe of the assessment 
program ar^i the procedur-es to be followed by each school were discussed. The administrators explained the 
method of selecting students in the sample to the school pnncipal and his coordinator since- it was their 
r^ponsTbility to obtain the correct number of students needed to take the test. The field administrators al$o were 
responsible for arjangirlg the dates and times for the "assessment to tdke place in the schools Tlie administrators 
• kept laclose telephone contact weekly with the field sup^ervisor to discuss their progranrvs and the problems that 
arose. * . ' - - . 

• Dunng the testing -process, the administrators^distrlbuted the lest materials to the students and read an 
introductory s<$tement to them, but all test instructions werelaped for the students. When the ass^nr^ent was 
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completed, the administrators filled out transfer forms used for recording the necessary data for keypunching 
cesponses which ultimately were to be* computerized. A check was made by the contractor on the test • 
administrators' accuracy in filling out the forms. ^ " 

Connecliojl comracled w*th Research Tnangte Insmule for the Febcuary, 1975. -sctence assessment. Ttie^ 
procedures for admihistermg the tests were very similar to those for the reading assessment, and they were 
monilofedv both during the training sessions and at the site of testing, by Connecticut Department of Education 
StSff Westinghouse Learning Corporation handled the test administration procedures for the second reading 
a'ssessment in the fall of 1 97&, and ih general, the same procedures were followed. ' ' 



Florida Procedures 

imistration of the assessment tests in Florida, which depends largely upon local distnct^fW school 
. lefrsonnel to make local arrangements and carry out the actual testing pr'oce^res, is the responsibility of the 
Student Assessment Section of the Flonda Department of Education. 

A distnct coordinator, selected by the district superintendent for eapK'of the 67 school districts in the state, is 
IfiSeoQsible for conducting the testing in hi$ or h^r.district. The^fe^ties entail the mailing of information and 
materi^s to the school coordinator and tesTadministrators^^Ji^ifimg the school coordinators, monitoring all steps 
relat^ to the assessnrient, and returning all asses^m^t materials fo the Florida ^Department of Education. 
R^lts of the assessment also are disseminatedjaiy :he district coordinator. In genera^ thesamrpersons4^e 
en acting as distnct coordinators each year^i^lorida's assessment, providing continuity to the program. 

Each school has a school cp^rdmator in direct charge of testing at the school. Test administrators, who 
usually ane counselors or teapms appointed-by the school (Drinapal. help the school coordinator in this task. 

fining sessions fprihe district coordrflators are ietfby'the Florida Department of Education staff with one 
^pr^on from the coritractor's staff present to provide technical explanations. Florida found 4hat it js more 
successful to have Department of Education staff members lead the/training sessions than the contractor's st&ff 
because ofjhe Departrnent'sjarfiiliarity with the needs and problems of the local districts. Several training 
se^ions are held in di^fferepKegions of the state so thai the distiict coordinators can attend the session closest 
to home. The district coordinators receive the information they need to instruc't the schootcoordinators and test 
administrators from the district coordinator training sessions. 

Following the training sessions, the district coordinators tram the school coordinators. Thfe test administrators 
^re trained either by the district coordinators or the school coordinators. Portions of the tests are given verbally 
by the testadministraftor, but most of the contents of the tests and the instructions are read by the student. 

Training materials are provided by the contractor, including manuals for the district coordinators, the schools- 
coordinators, and the'test adjpiinistrators. as well. as transparencies and a filmstrip. These materials are sent to 
the distrigt. coordinators two weeks in advice of the training sessions. The contractor afso ^akes care of the 
^apkaging and mailing of the assessmen^test$ and materials. 

An evaluation is performed by-fhe contractor of the effectiveness of the training sessions and materials 
through the use of questionnaires and interviews. The contractor summarize^the times when specific directions 
are not followed ciotrecfly' as part of the evaluation. District coordinators me^t twice annualify; flrst.^o draw 
' and^nake recommendations\aboutthejpethods and materials used and again, to review the results. 



:hlgan Procedures 

Michigan! too» depgr^ upon local district officials to make local arrangements and to administerV)e tests for 
the assessment programr^Michigap uses a systWn of coordtn ators similar to tha^ of Ftorida. A local district 
-coordinator is designated for edch district bVthesuJ;>erintend^entof^he <l^s^^ district 
coordinator for each 'intermediate districtis appointe d by the \niekned\a t'> ^''^nct aipflr^^ SMrhfrnh 
coordinator is appointed for MCh'.schoor in thelSTsS^^ distfict 
coordinator. Assessment administrators are selected by local school officials. 
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*The' local district and intermediate dis 
from the contractor; tram the assessment 
unused or extra materials; return the tes 
Assessment Program Scoring Service; anc 



coordinators distribute to the schools the materials they receive 
L(Jministrators; collect the test* booklets and an$wer sheets^ destroy 
lanswer ^e^ts* and related materials to the Michigan Educaltofial 
Inswer questions that might arise about the program and materials. 



Vhe school coordinators send the asse 
appropriate assessment administrators. Tl 
administrators and teachers to explajn*the 
provided by the Michigan Departrtient of E 
return all the materials; used and unused. t( 
explicit instructions given m a manual. The 
uniform, statewide admjnistration ol the tests 



iment materials they rleceive from the district coordinatQrs lo the 
schooj 'coordinators also arrange meetings vwth the* assessment 
irogrdm and to Show them filmstrips about the program that are 
ication. After the tests are administered, the school coordinators 
he local district or intermediate district coordinsUors according to 
lanu^ contains detailed, step-by-step instructions to help ensure 



The assessment administrator can be a cjaii 
of students are taking the tests. Proctors cai 
than 30 students kre being tested. Assessi 
\es\s to record ad^^prse physical conditii 
such as illness and unfair assistance. Such infol 
or to the Michigan Educational Assessment Pro1 
districts who'wiii^nterpreting the results. 



'obm teacher or couriselor, or the school principal if large groups 
as§ign€crTo assist the assessment administrators when more 
^^ministrators monitor the students when they are taking the 
propriate group reactions to the tests, and individual situations 
.lation IS not returned to the Michigan Department of Education 
[ram Scoring Service, but is retained by those in the schools and 



The administration^of the ttest battery is mgnitdfredby Michigan Department of Education staff in asampling of 
the school districtsm order to see that a uniform dtlmjnistration of the-tests is maintained statewide. 

Table 14 indicates the major elements of the te» administration procedures followed by the three states. >. 
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.Table 14 

Major Elements of Test Administration Procedure^ ^ 



Procedures 


Connecticut 


Florida 


Michigan 


Principal responsibility 
lor test administration: 


. Contractor 


Local districts^ 


Local districts - 


'Personnel involved* 


10 field administrators - 
& 1 supervisor- inter- 
viewed and hired by \ 
contractor from list 
^supplied by local district 
superintendents 


; ^ 7 

District coordinators 
appointed for eacli . 
district by the district • 
superintendent 

School coordinator for 
eacti school appointed 
by school principals 


,D^trict coordinators 
appointed for each 
district by the district ' 
superintender^ts ' 

School coordinators 
appointed by local 
, district coordinators 


• 


. ' . <> 


Test administrators 
appointed by school - 
principals 


Test administrators 
(usually teachers) 
appointed by local 
school officals 


Training 

w 

k 


Supplied by contractor 

r 


DOE traips district 
coordinators with • 
contractor present to' 
cover technicalities 

School coordinators 
trained by dtstnct ' 
coordinators 

Test administrafors o k 
trained±)y district 
coordinators or school 
coordinators* 

Mangals supplied with 
instructions 


Supplied-by DOE for ^ 
district cbordinators 

School coordinators, 
trained b^| district 
ccfordinators' , 

Test aflmifjHStrators 
trained by district or ^ r 
school coordinators 

Manuals prlovided 
district and' school 
coordinatoris and test 
adhnjnistratVs with 
detailed instructions - 

. . \ - 


Monitoring or evaluation 
of procedures anc^ 
. materials: 

■ 


Performed4)y DOE Staff 
and contractor 


Performed by 
contractor and district 
coordinators 

• 


Performed by DOE staff 
in sarliple of school 
districts; schot)l test 

'administrator monitors 

students for adverse 
testing conditions and 
reactions to be reflected 
in interpreting results 
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Results *. 
Introduction 

- Probably the two most important aspects of 6 'state assessment program are (1) interpretation and 
transmittal of the results of the program in an understandable form to the diverse audiences for whom the 
findings are intended, and '(2) commitment "to see that constructive use is made of the information. 
Dissemination alone is a difficult task. Full utilization of tJne results may not be immediate because it takes time, ^n 
terms of years, to collect e nough information to be of constructive use. But utilization is the foremost and 
ultimate purpose of an ^assessment, and accounfabilfty program. Without proper dissemination of the results, 
utilization may not be satisfactorily accomplished. Many of the problems ahd misunderstandings that anse in 
assessment and accouiitability programs are the result of lack of communication. - *^ 

Ideally, understanding of the program should be promoted vigorously ihead of time, and the results of the 
program should be interpreted in understandable language f6r thei several different audiences that most states 
mclutte in their reporting efforts. As Frank B. Womer states in Developing a Larae€Qale Assessment Program, 
one cannot assume that interpretation of the results will take place, nor can one assume' that the.re$ults will be 
used automatically. An assessment program is a waste of effort and funds if it falls into nonuse. It is necessary to 
use vanous methods, in addition to the written reports of the results, to be certain the results are communicated ^^ 
to the pertinent recipients and that something is done about the findings. ' ' 

^" • . ' ,^ . - 

All the states across the country which are conducting' state assessment programs have printed and ' 
distnbuted reports which generally contain the background and objectives of th^ assessment program, the 
procedures fofcwed to operate it, and an explanation of the tables of statistics displayed. Sometimes both a' 
technical report and a more simplified report ara prepared, the latter appropnate for public audiences. 

* * 

Most states depend upon a CQnira<;te4firm to sopre and process .th6 assessment results and to analyze and 
' prfht them. Some states, iike Florida,^ have their results^yzed and rnlerpreteti by consultants with involvement 
of department of education and district subject area sp0Cialtsts. * 

Michigan preparfes explanatory materials to accompany the printed reports so that teachers an4 
administrators can analyze results in terms of their own goals and objectives. Regional workshops are held^to 
provide information to the^lod^f school personnel, and^olor filWistnps containing information Jor ihterpreting 
results are distnbuted t.o the tooal districts. ^ ' 

Michigan also is Incorporating some other systematic approaches with the<r dissemination activities. A 
dissernination model has been prepared by the Michigan Department of Education 4or the Cooperative 
Accountability Project which both state and local agencies cai;i draw upon fpT guidance. « A full and.active 
dissemination program that goes beyond printed reports/requires constdera^ human and financial resources, 
but a state can begin with printed reports and releases td the newsjriedia, with attention t5 clarifying the results 
for the local media, and wor4< Into other approaches when resources bea>fte available, y 

The audiences selected toVeceive reports of the results are detjeffmined by state board ahd department ol 
education officals, or stale legislatures, and even by public pressure. Connecticut, Florida, and Michigan were 
given some directives in their legislative fcts concerning which ^fences shoufd be included m the transmittal of 
results, although none of these states is restricted in this Sensa^he Connecticut law calls for a detailed report to 
be Wmitted to the Governor and Connecticut General Asserhbly in which recommendations by the State Board 
6f Education for'improving educa'tion can be included. Z,^—: * 

Flonda's law specifres that the Commissioner of Educatibn is to make an annual public report of the 
' assessment results for each school district andior the state. EachTdistrict's school board Is to make an annual 
' public report of the results lor each school in the district, and must -file a copy of the report with the State 
Commissioner of Education. Finally^an interpretation of assessment results is to be reported \n ^ach school s 
annual report of school progress which is sent to the parents of all childrdn in the school. ^ ^ * \ 

Michigan's statute simply States that public release^ of information about .the progress of the stlate system of 
education is required. - ' ' ' ' ' 

Fftftk B. Womar, Dmmiopii^ M Large^ScHe Assessment Program {Denver: cW«atlve AccoutabUity ^[oW Jf J3) , pp. 80, 84. 
« AOfssernirmtlon System for State Ac^tebillty Programs (Denver: Cooperative Accountabiltty Project, June, 1973) . 



How Connecticut, Ftonda, and Michigan hancjie the reporting, dissehmhation;^nd utilization of their results ts 
described next. . 



. r ConnectiQut Results ^ - 

• • ' ' ' <■ . 

ScoFing and Prodessing of Result^ 

'Scoring and prt)cessing of assessment results in Cor^negticut are Contracted to a commercial firm. 

Reporting'Categones ^. , / *'C^ 

*.■"** ' . - ' ' ' . ' ^ 

The assessment resutfs show state; nla^ional, and. northeast* regioh^f median Scores (percentage correct) for' 
each objective in eaph age group/,by'sex and by size of <:6rf)munity' (large cittes, fringe cities, mediucncities, and: 
.smaller towns) . Tables ^nd bar^graphfe illustrate the results. ■ , . ' 

Interpretation of Results • . • - ' • 

No interpretation df results at the district; school, of (^assroom level is possible because ho identification' of 
student, school, or community ts made through thedata cd^lected. ' ^ , 

Dissenrtination of Results ^ w / ^ . ■ .' . . 

A technical report is prepared by the. contracted firm pnm&rily for use In the*Gonnecliciit,,Department of 
Education A copyjssent to the state- lib/ary, some.^ollege libraries, and to the ERip Processing and Reference 
Facility. ' ^ • ; . • • 

A public report is prepared m a more sirpplified form and,clistril?uted to the Connecticut Department of 
^ Education staff, the Sta^ Bbard:vOf Education, Governor, Connepticgt^General, Assembly, school districts and 
schools, teacher or^aniz&tloflTs, school libraries, parents, school'patro'ns and citizens, other spates the Dress 
ERIC, and the U.S. Office ofEducation. ' / - • ' 

Another kind of.' report is^ prepared, annually jorthe jSovernpr and the Connecticut General As$embly .in:! 
response to the Connecticut General Statutes which request an evaluation of all of the* educational programs 
mar^d^ted by thie General Assfernbly, Including the assessme'nl.program: The objectives of each prpgram, its 
expenditures; and^he need forjhe pr^ram is reported alorig witfi (iocorhmendatfon^^rf any. 

UtilizSWh of Results \ . ^ ^ ' ^ - ^ 

Results are used ^0 establish prto(ities qf needs for the purp<3fie 'pf. appropriating state and feder^kfunds ,to 
meet the Identified ne^ds and to determipe program effectiveness; 7 i - ^ - V. i ^ 

- The reading assessment report is supf>lying bdse data that>Tfect program d©<ii^ions tor reading both at the^ 
state and Ideal levels. ^ ' . ' 

' ' - . ,■ '.' ■ r , ■ . . 

* '< Florida Results . v , 

Scoring and Proce«5si'ng of Results ^ ^ 

Scoricrg is completed by the contracted firm. The Department of EducaTten aJialyzes the cpmpgter taffes 
supplied byjhe^ contracted fym, interprets the resutts. and prepares printedYepoCts. The pontre^ctor supplies a 
final report which contains item analyses, a review of procedures'to'identify; needed changes, and the results df 
suppiemeritary studies. Census testing began in Florida during the 1974-73 sbhi^bl year, md the contracted firm 
how prints Individual student reports in order to return the resorts to the schoofsmore q^icWy^.T^ie Departme.nt of 
Education still processesail other reports. . ; , 



Reporting Categories .... ' 

* ' • . ' - . 

Pnbr to the 1973-74 assessment, results vyere reported in terms of percentages ©f students who achieved 
each dijjectfve atlhe district and state levels only^ In t973-74, enough student^ were tested so that reporting * 
cojidlake ptece^t the'School level for a portion of the districjs. Achievement of the objective was based upon a 
criterion established for each- objective by a task force ass/gned to eaeh^^ubject area. The criterion -was the 
minimum number of items that a student had to answer corjfectly in order to attain the objective; i.e., four out of 
fivQ.ffvedutotseven/ettJ. The criteri'a varied for each objebfive. ^ • .. \ . 

In 1974-7^5, all. students were tested and results were reported in terms^of percentages of achievement of 
Items rather *than "objectives at th.e student, school, district, and state levels. The school r-eports are organized by 
' objective aod contain the percentage of achievement on^every item' for the school, the district, and the, state. A ^ 
distriqt percentage report reveals how every school rn the district jDerformSd on each rtem. ^ ^ 

Florida also prepares an individual student report for eacfa student showing how many of the items for each 
Objective Were answered correctly. K isexpected that a normative score vyill be prepared in the future for the total 
test and for each>subject area so that a stodent's achievement can be cornpared with other students in the state. 

Florida legislators have been asking'for a single score so4hat they can determine the relative effectiveness of a 
school or district educational progtam. In order tp comply withjhis demand. Department of Education staff have 
developed regression formulas so that the total score on th^ entire test and^on each subject area can be 
compareyd with a predicted scorelor the school or district based upon non-school variables. 

• « 

* Results for Florida's replicatiori of the National Assessment of- Educational Progress in reading and 
mathematics will be reported in the foTffi of percentages 9! achievement on the items* used to assess the 
objectives. State percentages wilf be compared* to the nation ^nd the southeast region. Results afso will be 
analyzed bycategoriessuch as rac^, language, and sex.'. r. • ,^ * * 

Interpretatiop Of Results \ 

' Statewide results have been analyzed anxj interpreted by Florida Department of Education consultants and by/* 
sublet area experts under speciaLcontract. Recommendations for inrprovement aresuggested where needed. 
Districts and schools are responsible for the analysis-of their results; ^ 

pisserninaiiori of Results ( / " 1 

' A senes of v^ritteh reports, including several technical repbrts^nd a summary report, are sent to the^o<^ . 
districts and schools. State legislators, the news media, and other states \ • - xW-.' 

News releases are preparetl by Florida Department o{ Education-staff, and tesjimbny is [Provided t& legislative 
education committees upon request. Each local district is responsible^ tor distcibuting th^ assessment results.* 
locally and to local media, usually through the district coordinator who has direct contact^-wjth parents^ schopi ' 
staff,an€lother citizens of the district. \' • ? " >^ ' /• ' 

" " . ^ > ' ^ ' ' . / ' . ;^ 

The results of tfte replicated National AssesSmenf .of £ducaiip>ial Progress will be d^stributed^to the sghObl 
diSt/t^is and to the Florida House and Senate Eduction committees. ' • ' ; * *, * - 

^ Utilization Of ResiiHts - 

CQmparisqns can.bem^de between school and district" results or between district aad state re5ults..Caution* 
mvist lire e)^ercis,ed in.tNs process by considjer mg the variables that coold'aflect the scorea, urifess the groups that 
are chosen for comparison have simjlargharatitefistiC^. ..." . ^ ' \- * . , 

^Schools and districts can deterrjiirie how much progress -they, are making toward their stated goals ahd 
objectives, based, upon tieirjocal ' problems and needs,;so-t)i.a.Leffeotivene^ and improvement oan be^ 
#monit6red. / . : • ; • " •*. 'X*. . 

The present /previous summary included vyi^h th.e .Clistrrc:l reports dSih be used by ihe^district^to ch^ trends 
and to develop new-gioalswhteh reflect the n^(3teo^*the^^ • V ~' ' ^ ' ^ ^ 



^ • The district percentage sunnnnary included in the schoolreports can be analyzed by educational personnel at 
thedislrict level for patterns of school performance. Sch<?ols with consistently high scores in-a particular subject 
^area can be identified so that their program^ can b§ reviewed for possible use by other^chools with low scores. 

. ' Michigan Results 

• Scoring ^nd Pr6cessing Of Results 

Sconng and processing of the Michigan assessment results is accomplished by the contracted firm. 

Reporting Categories Prior to 1973-74 * 

Before objective-refer^ced t.esting began 'in 1973-74, reports were prepared for the local districts based 
upoh the result^ of norm-referenced testing of each pupil's basic sl<iills portion of the assessment battery, 
excluding the first year of assessment. These results were reported in 'terms of the pupil's standing in relation to 
other pupils who took the tests. Pupils' scores, norm tables, and'technical information were provided so that the 
local schools could determine how well each pupil Wa^ performing. ' ' , 

Reports also wene prepared for the local districts based upon the school and district results of all measures 
used 1/1 tha assessment. These included district and schobf-scpres, norm tables, and explanatory materials so 
that the local districts could analyze their own results. 

^ - A .distrnct'by.tdi^tnct summary identified the relative standing of each school district through the use of 
standard scores and percentile rankings, • ' ^ , 

Public r6f)l)rting of t-he results entailed feports for gr'oups Cxi distncts, school, and pupils, with scores presented 
inperc'eriWeform • ; ; , * ) . • • * ' 

Reporting^^ategorids 1973-74 

. For the t973-7fas§^ssmfent, ^results of the objectiVe-refe/ehced testif=ig in rnathematics and reading were 
Reported oh an mdwdual, student, c4assroc^m,~ schoel builcffng, school- district, and state-fjfvel basis. At the 
student level, jiae da^a showjBd whether or^not the student correctly answered each test item, X\\e number of items 
.aifiswered correctly fQr'each 6bjective, and whether or not the student had attained the objective. "At the 
^classroom, school ;.^^^d.dls^rjc;t level, |he informatjon indjcated the percentage of students who answered none, 
one; two, three, foOf or all of tKe^ive it^mS'fof'i^acK c^jf ptiy^ percentage of students who achieved each 

objective. The criterion level for altaihment of eacb objective' (Uhftkg Rorjda^eriJtedp.vy^ljiictj va^ried with each 
Qbiec4ive)' is sot at answferirtgcorre<5tly four out of the five items fpr each objective"ih\order t6V*|diJCe thf Cha^,-. 
of guessing the-.nght answer'on the multiple choice items. Agisting of the Students. in^ each classroom who* 
attained eacfi objective ateo was provided, \ , ^ *. , . 

• ' — ^-^ ' ' - i ' ■ 

•'On-ttie word relationships test, results were reported in three ways^for individual students: (1) a raw score 
which indk^atedthenurnb'ea^df Items the student answered cor ^2) a standard score; and (3) a per cent 
below;^cor^ Which shoWed the perdpntage of studenti that had a lower standard score. SomiTierieS of .this ^ 
jnfornn^tion, presented in^^ standard score distribuflon, were provided at the classroom, 'school, and dfetrict ^ 
(e\iels.,i,' • . . . ' ' \ , ' , / • , ' 

fteports of.the attUude test results-consisted of summary information at the classroom, school, and district 
/.levels.iJo ind^viqjual results wefeprepar^d; the questidnnd^eswere anonymous. , ' - 

Reptorting Categories 1974-75 ' ^ \ . * : , 

Fpr the 1974-^5 asSessmjpkLOawlts of the ot>jectWe-r^ferenced tests in reading and mathematics far grades'* 
4 ^n<£7 Srepres^ted in the^same manner as in the 1973-Z4 program. Information again is reported by indi^vidual 
student and at thefclassroom,*$chool, and distrjcf levels. The Individual Student Report shows how each student 
'ahsyjrred.tK^'test tguestions and whether i)r not the.obj<^tves were abhieved^The Oassroo^ Listing^Report 
.^sumir^iies for each teacher the performance of eacfr student ici the class and the^class performance oh each - 

^ ''f •'. ' ^ 6.8 ' ■ 
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objective* The scPtool principal received a set of the student-records and a' summary report for the.scKoof: Data* 
foreachschooibuildir\gandfor1hedistrict were^n\toUieki)M " ' ' \ 

' ' • ' ^ > * 

Because of the sampljng procedures used for theN^rst grade assessment -only statewid? resuits^Hi^e 
- cbmpited forimiTted pubffC release and ^or stdtWfictate, ofcrt^eac^lassroom ami school received data w Ihe 

• otf}ectfves they tested^ . ^ . * A "^-^ * • . " • 

Other report will be, prepared for groupings of districts andschoo^lsTArihe-^Qurth and seventh gra*des two 
^uonal methods of /eporjing^assessment results will be available to^ach school district: t-1)-^venth grade 

• results will be repocted accortding-to feeder elernentary school at no extra cost^o the dJstnct, and (2) an optional ; 
'research code" foethod Will be utilized that will enable the districts to .observe the relationships' between 
avssessment results and other educational variables of particular Interest to the district. This option will be 
processed at the local district's cost/Frdm the begirwimg, thd assessment program^ in Michigan has been . 
collecting, analyzing, and reporting descriptive data about each K-12'distnct'on a number of variables 
categories of human resources, district financial resources/ dropout Fate, racial-ethnic rriinonty staHiSrantr^'^ 
district size measures: These vanables are variously reported at state, district, sthooMclassroom, arid individual - 
student levels Stpdewt background characteria ^ previously were coitected, but these measures were ^ 
discontinued because of the controversy they genHi^d a/nong parents, . 

' • ' " - ' 

The word relatignships test and attitude test were avaitable on ah optional basis m 1974-75 Reporting for the - 
word relationships test consists of individual pupil results as well as siimmaries at the classroom, school, and 
district levels. No individual student data are reported for the §nonymous altitude questionnaires, but sijmmary. 
information is provided at the classroom, school, and distncr levels, A statewide summary and item,analysis are ' . 
provided to the participating districts after all the arata has been processed. ; * *^ 

'Reporting X^tegories 1975-76 . • 

• ' \ " \ . 

Reporting categories will be the same for^^e 1975-76 assessment as in 1974-75 except for the addftion of ^ , 
■ one other category. In 1975-76 eachi schooled district will be provided the perceT)tage of students who chose 
each pt^ssible answer for each item §ince the aftitude test and the word relationships test were-not offered in ^ 
1975-76*resultswillnot be reported in'Shese areas. - / » v " 

_ Interpretation of Rw^^ 1 : \. , _ ."^ * » , : 

E)fplanatory booklets prepared by the Michigan Educational Ass^^ent Program staff accompany the ^ 

• results The booklets are designed primanly-to help teachers analyze individual studertt and classroom results ^ 
and to help administrators interpret the school and district summaries of the results. The administrators also, . 
assist the teacher in interpreting student* §nd c-ISssroo^ results. Statewide results have been intefpreted.in , 
artlcles,repbrts,andspeechesbyMichigan6epartmen< of Education staff- ^ ' . 

The Department of Education staff cannot meet with each teacher or school prtnapal in Michigan's 5i1 local 
school districts, but the staff does conduct regional meetings each year to provide information to local school - 
' personnel about the results of the assessment Jfett workshops afeoffered for local district admimstcators on the 
'mterpretation and utilization of the Assessment results, find there is individual consultation with Itie districts. By 
contacting the key people in each distrt^t,- interpretation of the a$sessnpient program is communicated to others 
in the districts, tn addition, color filmstnps are disVibuted to the local sbhool districts which explain the program 
afid show how-.the results can t>e interpreted. A new Wmstnp speaktr^s kit on school utilization of assessment - 
' results has been prepared for distribution to each school district. • 

The Michigan Oepartnnent of Education is entering into contracts with various professional curriculun^ groups ^• 
xrCme state tMt are involved in devek)0ing the jobjectiVes and test items'for the assessment programs These 
/groups vfill be asked-to prepare interpretative /eports of the results and to generate constructive conclusions. 
The Michigan Educational Assessment Program staff will assist the curnculum groups by ^rving as resource 
persoTis. ' . • ^ 

Dissdnijhation of J^e^ults ^ 

^For^eral years Michigan has been disseminating the results of the state's assessment prognam; dunng this 
process TjrpWems were encountered that had political, ^Wic, and professional repercussions.. Certa|n{y the 
' program l^s.not *een embraced with open arms by everyonem the state;and critical articles about it have^ teen 
published Some of the criticism was ably relMted by tt^ Department of Education staff; jMi^ther ihfse messages 

: ^ - ^^ J^ ; j . 



have convinced Jhe program's detractors is o0en to'quest^on. The Department staff is making an effort to 
improve communication and understanding about the assessment program becatfse misunderstanding of the 
purpose and misinterpretation of the results of the prpgram have occurred,' An adV70C committee now is assisting 
the assessment staff m developing ways lo help ecfudator's interpret and use 'the assessment results, and the 
cemmmee^seoofdtf^attf^aridirnpfo v iri g d is se m inat i on methods.^ome of these methods are: 

* r 

Informational fiinistnps, audio tape, and^tory cards are sent to th^ local dismcts to increase teacher' 
awareness and understanding of the assessment program * 



• 



• An lOrdeplh tracing filmstnp,' audio tape, and booklets are Beirig distnbaled to teachers to aid them.in the 
interpretatioflof resjlts * • , • " 

• ♦ Bnefmgs are beir^g heldacross the state to discuss with the local educators the new objective-referenced 

testing procedures. ^ • • ^ ^ * ' / 

* • Training workshops are^ conducted «to instruct local test administrators, coordinato/s, and curriculum 

^ specia'^sts-in the interpretation and utilization of the test resuttsJndividual consultation is provided to the' 
- dL^tf^Qtj upon request " \ ' 

• Leaflets a^trKlhe assessment prograrAare dissemJiated to the local schools for pupils to take home, 
leaflets also are diStfibuted at parent-^padhers meetings and other organization meetings. 

. • •News articles are pf^f>a]'ecriRaT-highlight various aspects of the asses^ent. Articles are prepared for 
professfohal magazines. In the future^ more qf these articles wdl be interpretive, and they will suggest Yo 
members of the educational professfoh needed changes tq improve the educational system 

• Bufletins will ^demonstrate how locai disWt agencies can follow up orl statewide results to make local 
.appraisals ^ ^ \ 



% 




Utilization pf Results^ 

The Michigan Department of Educatlbn 'asserts thar^e assessment results can assist state professional 
QurffCijlum organizatiops in planning aad'lhal research studies can bfr conducted to d^cover- the fe^alfonshtpe 
between educalionaf variables and pupil achievfeient. Each year of the Michigan assessment program, financial 
resourqes.^reporled fbr every district in the sfaie ^d human resources are reported for ey^ry school, school 
distrjdt. and for the state. This information also can contribute to the interpretation of the assessment results. ' 

Title.! disthcts'use the Michigan assessment program data to assist in identifying the reading and mathematics 
needs of tbe pcipils. ^ * * ' , 

On the local level, when a,;large number of Jow-achifeving students j$ found in a- school or district, local 
educators can review their local curriculum. teacTiin'g materials^, and instructiorlal practices to see whether' 
change^ should'be made and if additional ajssistanpe ls^leeded*by the students. The results also can help 
parents who want lo supplement their children's school learning. 

Many local districts are making progress'ln estabtfshing accountability programs that are basietf upon the 
state's six-^tep accountability mocjel, of jA'hiqh the asses^enl program is one part. The sjx-step accountability 
model IS deiscribed in Section III under Status of lmplementatK>n of L^islative Acts by ConnectK^ut, Florida, and 
Michigan. . , ♦ , . 

* • - • * « • - 

' Cdst and Sfaffing of Assessment Programs In 
- Connecticut, Flprkte^^nd Mi^>^ifF»" - 



Table 15 indicates the approximate costs involved in the assessment programs of Cbf)necticut, Florida, and 
Mfchjgan for fiscaryear 1974-75. the percentage of the total funded by the staV and the people who nrwike up 
the staff responsible for the programs m eacft state. Costs do not include iUI time eqi^valent sateries. They iJo 
include contracted costs for such tasks as scoring, analysis, printing, and leit development, as v^l as for 
nr)is6ellaneous9upp«es,rt)atefjals,and9ervfc« o 



Table 15 ' 

ost and Staffing of Assessment Programs in Connecticut, Florida, anftlchigan 

. Fiscal Year 1974-75 



Stat# ' 


Cost (not FTE salaries) 


% State Funding 


= Staff 


Connecticut. . 


$126,000 (science, ages 
9, 13. & 17) . 


''56% 


Director o! assessmentr 1 consultant, 
1 half-tirrie associate consultant,- 1 
secretary. 


Florida ' 

V 


StOO.OOO (reading, 
writing^ & mathematics, 
grades 3 & 6) " 
• • 


71% 


Director of assessment, 1 edueattohal . 
consultantjil. 1 educational 
cpnsuifant II, 1 school service 
specialisj, 1 statistician. 1 statistical 
aide. 1'secretary. 


Michigan 


$829,000 (reading & MM 
mathematics." grades 4 
7, grade 1 pilot test) 


too% 


Supervisor of assessment, 4 Ph.D.* 
level consultants, 2 MA consultapts, 1 
MA analyst* 4 secre|anes. 



status of Implementatjon of Legislative Acts 
Cohm 



lebticut, Florida, and Michigan 



To return to the legislation enacted by the three sfates, it can be noted that, m most instances,' the states have 
earned out the majorrty of the directives ^n Ihe laws or are.in the process of doiPf so and, in some cases, have 
institute<j step^ that 90 beyond what is specifically required by statute. 

CoR/iecticut . . , . • 

Connecticut's broad mandate to develop a plan for the asse^ment andevaluatioji of educational programs 
has resulted in the preparation of state learner outcome goals and three objective-referenced needs 
assessments^conducted thus far (on? scheduled fbr the fall of 1975) based upon the assessment and evaluation 
procedures that were developed ■ . . " . ^ - . ; 

Connectic<5t's six edycationaj goals not only reflect desired learner outcomes in that state, but also ser.ve a3 
ultimate cnter.a for Deftariment of Education programs and as the basis for the development of performance 
objectives m each unit of the Department for a program planning and budgeting system currentjy being devised. 
A Jotal of 1 34 objectives under five Department gpals was developed forM974-75. 

'Florida , • . * ' - 

Florida has been impfementing the directives for administering a statewide assessment program contained m 
the Accountability Act of 1971 and, more recently, in the 1974 Act which amended the earJier Act, A major 
directive m theflonda law that has proved difficull to implement is a cost analysis of educationial programs and 
an analysis of ttte differential effectiveness of instructional programs which is to be includecUn the annual public 
feDort This iS a complex procedure to develop and make workable.So far information on costs and instructional 
programs has not been included in the reports of the/esults of the assessment, but a*1ootnote in Jhe 1972-73 
Technical Report smes that the collection of data for this part of thte, program "will become operative at a later 
date.'*'*^ . > 

Th^ Florida Department of Education's Research and Developmenl Section ja^^^&yelQDing. methods -ahd 
techniques concerned with co?t analysis that are being operated on a trial basis in some of>re4ocal districts. 
One method is called the Cost Analysis Management Information Ssytem (CAMIS) which is copyrighted, and 
the Department of Education hopes that all the Ffonda public school districts will be using the CAMIS system 
Within the next few years (^nder this system a district can ascertain the cost ofa new offering, or of any subject 
area or grade level., compare the cost of one instructional method with anothe;; and use CAMIS yvith pupil 
assessment to evaluate the efficiency of instruction. Another technique js the Supplementary Cost\Analysis 
' which supplements CAMIS and is being tested in pilot schools in the State. By this method detailed cost 
intprmation pn a limite'd program can- be obtained, for example, the cost of establishing a chemistry laboratory 
course •* . ^ . , • 

The CAMIS manual was issued to Florida School distncts m September^ 1972. It*was rewsed in 1974 and 
1975 following a numfe of developments regardir\g the use of.the manual which necessita'ted modifications.rn 
1he system and a plan for uniform mi^mum implerpentatron in all distncts by 1975-7&^-._ 



Michigan . , ; 

• After the administration of the first assessment, the Michigan State Board otEducafion adopted an analysts 
process, or an accountability model as 4 is commonly known, made up of six elements or a series- of steps thgt 
are intended to lead to better education3l planning both at the state and local levels. The six steps are: 

1 Identification of common goals f " 

2 De>^opment^of.p9rforman§b objectives 

3. Assessment of needs ' * • ^ * * ^ 

4 Analysis ot^delivery^ystems / " • - • ' 



1972'T3 TBChniG^ f^tf^. Section I Asses^t Procedures (TaNahMee: Department of Education. 1974) .6. 3. footnote 3 
ArMee on Educiionei Aopountifmy in Unrmsei B^gUsh (Taiahtseer Department of Education. Febcus^. 1573) /pp. 14, 15. 
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5 Evaluation ^ i 

6. ReGommendations for improvement * . - • • * «!* ' 

The goals have been ideht»lied at the state level. Minimal student performance objectives have : been- 
* developed for^he academic goals Fn several subject^ar^as and now areJjeing fefinecf.t ach distnct rs encouraged t 
to articulate its own goals and objectives tcTsupplement the state's goals and minimal objectives. 

The third step is proceeding \n the form of the annual statewide assessment which provides information on 
pupil achievement and needs and collects data on staff, school, and financial resources for .each School system 
in the s^tate. Local assessment programs are encouraged. The Department of Education is planning to conduct a 
comprehensivaprogram to help local educators develop the?r own assessment measure; this program pr(*aWy 
will involve in-service training financed with state furkJs. 

The fourth step, analysts of delivery systems, is concerned with the use of resources by the educational 
system to serve the needs of the pupijs. The Instructional Specialist Program »n. the Michigan Department of 
Education is assisting local districts in analyzing their deliyery systems in each instructional area, investigating 
the use of their resources, and adapting their programs to these needs. , • . 

Evaluation, the fifth ^tep; indicates evaluations both at the state and local levels to determine the effectiveness 
of new programs, this information wiH provide a basis for determining continued allocation of resources to the - 
programs. Successful progress can be<dentified and programs more responsive to the needs can bet offered. At 
the present time, the Michigan Department of Education is evaluating seven of its programs. The evaluation 
encompasses approximately 1, 1Q0 projects in more than 5004ocarsghool districts. Consultative services and 30 
or more workshops are conducted annually throughout the state \6 furnish technical assistance on evaluation to 
local agency staff. The Department ajso is running a survey of local and intermediate school districts to . 
determine what resources and capabilities they possess for evaluation. More adtequate services and expanded 
activities will be offered based upon the results of the sun/ey. , ' 

Recommendation for improvement, the sixth element, draws upon the previous five steps and o^ers to the 
community recommended changes for' the adoption of successful expenmental or demonstration programs « 
identified by previous steps. 

Many local distrjcts.are maKiDg progress in establishina accoupjabih^^^ based upon the 

state's siX'Step accountability model. They are tneing encouraged to develop such.^ model *irough a pilot 
program conducted by the Michigan Department of Education in elementary schools, six secondary schools, 
and an intermediate school district. The Department staff works closefy with the pnncipals, teachers, and 
acJministrators m the districts to implement each step of the six-step Michigan accountability model. The pilot 
programs serve as demonstration models for other districts and schools which want to introduce the 
accountablity model. Consultative servjces^ and workshops are offered by Department of Education staff to 
provide technical assistancwn developing the model. Those involved appear to be generally satisfied with the 
plan and consider it a success. Both \t\e Elementary and the Secondary School Principals Associations have 
requested training sessions for showing their meml^ers how to use the model. ' * , ^ 

Another impetus for local disjncts and schools irr^plementing accountability programs sirViilaf, to the state 
accountability model is the inclusion of the six-step accountability model as^a part of the proposal needed in the 
local districts' applications for compftftive grants under ESEA Title III. By 1974 more than 60 local school 
districts were using the six-step model thVouph the Title III grants. Atthough technical assistagce and workshops , 
are provided by- Michigan Department of Education staff in the distncts that request them, limitation of 
Department staff has Ca&ed delays. Jt is hoped that those who learn how to implement the mo0^. will be able to ^ 
help others appfy It in their particularschool or district. - ^ ^ 

Michigan's Assessment Act requests that the school "systems^ be provKJed "with strong incentives It) 
introduce edMcational programs to improve the education of ^udefntS in* such basic skills and model programs to v 
raise the tevdl^f achievement of students" (Sisc. 1 (c) of POblic Act No. 38) . Michigan reports do not , 
sp^fically indicate what '."Strohg .incentives" have' been introduced, although application of the six-point 
accountability model is addressed to new and model programs to raise the achievement of students, and the 
pilQj prograr^^and the use of the model through ESEA Titl? Ill competitive grants have resulted in iAiptemeatation 
of t>wmodelatthelocarievels. * ^ . 

Compensatory funds from the Michigan State Aid Act to irriprove the perforrnance of students also may be 
perceived as an incentivie for some of tt» local districts. A^.mehtJoned eariier in therisport; funding was auppHejJ 



by the Michigan 'State Aid Act. a four-year program, which amounted, to $22 million in 1974. After the initial 
Identification of a district, with large numbers of fow-achieving students (those vi^ho fell below the 15th 
percentile) .-the district cofitinued to receive fjjnds orHy if satisfactory progress was shown by dn evaluation of its 
cornp^^ato.ry, program The schDol received $200 for each pupjl who sub^quently aciijeved 75 jpei cent of the , 
performance objectives set for him and this amount was prorated for lower achievement. Fur^ding was based 
soleiy upon these students' pretests and posttests appropriate for the object^ves of the local district's program, 
and monetary assistance was to be cut back or eliminated when schools did not show success fn raising their 
performance level The state 'assessment program was not used to measure success of a district's Tbrogram; 
each district chose its own test instruments jo measure their student progress There were 529 K-12 districts \f)' 
Michigan m 1974. of whicbi67 received funds from this program, ranging from $6,000 to $1 1 million. Detroit, the 
larg^t district, received about half of the $22 million. The program was audited m 1972-73, and the findings 
indicated thai out gf the 99.048 students pretested and posttested that year, 59.3 per cent achieved kverage 
gams equal to 75 months for each month of the program. Moreover, 34.5 per cent oithe pupils achteved gams 
equal to or greater than one month for each month in the program * The program was not entirely successful, 
however, principally because it proved to be impossible to withhold funds from a large-dr^rict like Detroit which' 
has produced low'achievement scores but is well-represerS^d politically-m-the^tale legislature 



Tables 13-15 reveal what legislative directives required m the ConnectiCutTFtortda^^d Michigan statutes 
have been completed or a^e m proce.ss. other objectives completed or m process that are^n^l^equired in the 
laws, and future objectives interpreted t)y the agencie&to be m keeping with the laws. 



I Table 16 

Status of fmplementation of Connecticut's Public Act No, 665 




Legislative Directives 
Completed orin Process 


Accountability Obiectives 
Completed or in Proc^ 
tlotf^eqoired 1nl.egtslat!on 


future Objecitives — 


Developed a plan for the assess- 
, ment and evaluation of educational 
programs 

Prepared 'public results of assess- 
ment program and an annual re- 
port To Governor and legislators 
contammg evaluations and recom- 
mendations for ell other educa- 
tional programs mandated by the 
General Assembly, including the 
assessment program 


Developed state c 

Conducted 3 ass 
ing, science, and 
assessrrieni) _ ^ 

Ep<5ouraged dis: 
comparable local 
grams 


joals . 

essments (read- 
second reading 

nets to develop 
assessment pro- 


,To refine state goals 

To continue ass^ment on an an- 
nual basts m severaTsubject areas 

To develop an assessment predict 
tion iristrument to show per^ 
forma nee level expectations of dis- 
tncts,. taking vaciables into 
consideration 

• * 


' . ■ . ' .J* ^ >' ' ' 









' * Sf«/f BR^orise to trm MEA/NEA P^o^ Report, An Assesasmeht of the Michigan Accountabi^ System {LensinQ: Department of 



. ^ EiJucstlon. Apr9 30. 1d74) p. 29 
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table 17 



Status of • 

Imptementati.on of Florid3*s Revised Educational Accountability Act 



' Legislative Directives 
Completed or in Proce^ss 



Accountability Objectives 
Completed or in Process 
Not Required in Legislation 



Future Objectives 



Developed • and administenng 
statewide assessment program, 
using critenon-referenced testing ^ 

Established performance objec- 
tives in reading, writing, and math- 
ematics for grades 2,3,4,6, and 9. 
and in science for grades ^ anct9 

Prepared^ and interpreted public 
reports of assessment results 

Department of Educalion assisting 
local .districts to prepare annual 
public reports by grade and sub- 
ject area for each- school in the 
district 

Changed" to census testing of 
grades 3 and 6 in 1974-75, as 
requested m amended law 

t 

'in§ for census testing Of 
'^adesS through 1^ by 1974-75, as 
requested 7n taw , ■ , 

Replicated a sample N AEP assess- 
ment to compare state results with 
national results 

Developing objectives which 
reflect termmal outcomes, as, re- 
quired in amended law; these are 
in the ^form of general skills state- 
ments 'rather than specific objec- 
tives 



Developed state 




loped Cost Analysis Manage- 
ment Information System and the 
Supplementary Cost Analysis Pro- 
gram 



To provide pred|ned scores based 
upon 1974-78 non-school vari- 
ables for cornpanson with total test 
score results 




To prepare §pecial resfearch 
ports, such as reporting lesul^by 
categ6ries of sex, race^ and 
socioeconomic status, anq relation 
toother vanables 

To prepare an analysis and recom- 
merKJatior^'poncerning ,the costs 
and^dtfferenfial effectiveness of in- 
structional programs required by 
law to be included m the afmual 
public report 




\ 

\ 



Table 18 



Status of Implementation of Michigan's Public Act No. 38 



Legislative Directives 
Completed or in Prodfess 



Developed state goals 

Identified st^jdenrts in. need of 
remedial assistance and provided 
rnformation for allocation of state 
funds 

Assessed two grade levels (4 & 
7) anjiually siffce -1970. Expansioa 
to grade 1 took place in ;974; to' 
grade 10 m 1975 (pilpts) 

Introduced objective-referenced 
testing as a better way to deter- 
mine achievement and learning of 
individual Rupils and to obtain 
more useful results for planning 
remedial assistance programs 

Six-step accountability model pro- 
vides' for evaluation of programs, 
\mfroduction of new programs, 
\changes m programs for improve- 
ment 

Evaluation iof several Department 
of Education programs being con- 
ducted that involve l.tOO projects 
in more than 500 local distncts 

Information is collected on staff, 
schQol, and finanera* resources 
and Used \Virh the information on 
pupil achievement to improve edu- 
cational decision making 



Accountability ^jectives 
Conapleted or inwocess 
Not Required in Leghjlation 



Performance objectives deveioped 
fn 8 subject area^; others b$ing 
developed or being refined for 
other grade levels \ 

Development of the srx-step ac- 
countability model and a pilot pro- 
'gram to^implemenj ^he rpodel in 
local distrfcts and schools 

Consultative services and work- 
shops to provide technical assist- 
anceto local districts in the area of 
evaluation - 



Futurepbjectives 



Preparation of^erpretiv^ reports 
of assessment results 

Annual audit of the assessment 
PQlicies and procedures con- 
\ducted by advisory groups in Mich-' 
^gan 



Ari^ctive promotion plan for dis- 
semination -and utilization of as- 
sessment results and the meaning 
of accountability 

In-service training funded by the 
stale to help'local educators devel- 
' op assessn^ent measures 

Training sessions jn the use an^ 
implementation of the six-step ac- 
coUntabflity model in local districts 
and schools planned for Elemen- 
tary -and Secondary School 
Prjncrpals Associations 



SECTION IV. SOME MAJORySSUES 



Accountability is a very complex theory to put, into practice, therefore, It 
Uanstete accountaWity mta workable procedures h^ve been iDeset by n 
.diflicuities stem from the current "state of the art" and are technicaK-w 
frustrating, and generally political in nature. Some of the technicaK communi 
emerged during the course of the resear9h for this report are described in thi 
early stages of developing accountability and/or assessment programs, we 
planning. For those who are further ^along and have, encountered such pro 
painlessly refreshing. 

Educational Acc^untability:'A Confusion in Meariing 

Supenntendent i)f Public Jnstruc^ion John Pbrter has defined educationa 
purposes as deternf^ining how the educationahfeomraunity, in cooperation with th 
student learning and perfbrmancc."* Certainly accountability has this meaning, b 
' for the efficient use of public funds through attention to cost analysis and public rep 



IS not surprising tha t attempts to > 
lerous -dijficulties. Some of these 
^le others are less^ tangible, more 
itive, and pohticafproblems vytiich^ 
^section/For those who are in the - 
iope this section will helpj in their 
>ms we t rust ^he revievy_W ilLbe- 



icQountability for Michigan's 
state's- Citizens, cw'^rvprove 

we wodd add the necessity 

[ting. ■ 



The meaning of-tli^e term -educatior^^l accourttabiljty" has become increasinglylambLguous because of the 
application of the wird to a particular method for achieving the purpose of the coitept. Thus.accountability 
often IS equated With f?PBS, teacher'evaluation, performance-based school accredifction or, most commonly, 
with educational assessment, all of which are different approaches for obtaining accountable re sults. In a ddition. ^ 
accountability has 4aHen on emotional overtones which strongly influence one's acceptance ot^jectioh of a 
particular method It fs fessential that educators, legislators, and citizens be !nf<:)rmedthat accountability is a 
continuous improverpfent process approached by many paths on a participatory or shar* responsibihty basis on 
the part of lay. legislative, and educational persons. Each me/Ziod utilized to achieve a&countability should be 
differentiated from the concep/ of-accountability and judged on its own merits. \ 

* Explanations- of accountability and the complexities of evaluation and assessment ^ould be reduced to 
language that is unders^rxdable to people who do not have the technical background for trte more sophisticated 
. terms used V ^^^V e(^ucators. In particular, this need applies to local beards of education and4he teachers, 
parents, and citizens du| in the local distncls. \ . ! 



Accountability: Locu^ of Control 



The concept of accoiintability and all its applications are predicated on the assumption Viat individuals or 
groups will be able to make better educational decisions by drawing from the best in-focma|ion ^ailable to them. 
Given this premise, it is not unusual that accountability ofjen has been analyzed, defended, aid assailed in the, 
framework of control theory 

One basic issue appears ta be state versus local control of the education otfere,d our youn^peopfe. Local 
-autonomy and local authority for making decisions play ajjiwe role in the Americap^sj^tenxb^ education.* 
Traditionally the state has given its constitutional responsibftiry for education^to Jhe locafeaucation^^^ but 
with increased state financing and public pressure for accountability, there are those whd believe flhat. stronger 
state influence and gufdance.is necessary to' ensure that the tax dollar is being used prodpctively. Sach^state's 
citizens must work out for themselves what the local/state^balance of control should be, but it an acdpuntability 
program ts being, introduced? it is imperative that locai educators, local citizens, and local ^professional 
organizations be involved in the design, implementation, and evatuaftion Of the programs. WitrtDUt such 
involvement, the chances of acceptancB at the local level will.be less certain, and the accountability torogram 
Itself will have less chanfe of Success. "Colorado'^ accountability program is an example of a strong %ffOrt 1o 
maintain local autonomy 'and to promote understandirig and acfceptance^ of accountability at the local level.- 
Although .the Colorado approach will take tim/ to implement fully, the. local district and state SGGOun\ability 
programs will have a Strong foundation upp^n which to build^cpun lability as a continuous imprpv^ent- 
prbcess. If no time constraints arfe imposed^ some states may want to follow the route Colorado has iaKen XO 
obtain accountable/esults. *■ .> - ' * 
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*'fhe Obtarvtttons 4rwj Conclusions of the Superlhtendent^of Public rnstructton." Part fff of the Putt's Undwptanding of 4 Amuae$^ 
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Planning Time i ? 

One of the most cocnmon problems wfth mandated state assessment or accountability programs arrses from 
ihe fact mat, m many instances, t^^e state education agency is requested to implement the progjam within a few 
months aller Dassagt? of me law. Ejiher the timeconstrayit isspecrf^caUy staled m the^aw^tseif {Ffonda) . or state 
budget 'aDprop^at)ons are granted that arc to be ex^c^ded m the fiscal year, w^ich usually mea^ns within a few 
moQth^ of passage* /Mich.gao) Florida's f^rst assessment had^ to be conducted in less than a year after the 
Accountability Act was oasseo. The Michigan state agency staff wanted three years to plan a comprehensive 
sta^e assessment proorarr^ msiea^^. the first assessment was scheduled to be administered only five months 
af*e;^ne funds were appropnaied ^, ' / ^ 

* A few states dc orovide lead t-me to make preparations to'- establishing a particular program Maryland is ope^ 
of these states whose 1972 Accountability Act mandated the establishment of an accountability progr^nvat the 
loca! school level and up to the Sta^e.^oard of Education l^vel Progress reports were not requesi€ija by law 
before January of 1975 for iransm-ssion to the Governor and General Assembly Similarly, Indiapa^pa^ed a law 
■n 1971 to develop a PPBSwp»:h IS to be operational by 1977 Sutticient tinie is necessary tp^<ll\^^ 
-and bu"d adequate support for it, particularly when citizen participation \% stressed J&lfterwise^ ^conciesSions 
h,}ve U? nrioe which may oe delr-mentai to the quaiity^of the program. Unfortuj>at%. many state legislators, 
citizens, anc even" some s4ate board ©f education members expect and wanfimmediate results Thts was 
part.c-.iar;/ Uae in the late 1960s and ea^ 1970s when citizen and l^^tive pressures upon education 
agencies ar d schools for accountable results were it a peak Now thai>0fher issues such as collective bargaining 
■arid school finances have moved to the forefro^t arid, m the hghtpHTie realization, gained from expenencl, that 
accountability and assessment programtS need time for plannli^impiementation, and evaluation, perhapl new' 
laws or programs will be less demandmgfrt^m a time frartip-^ * - ' 

Problems with p^ic^^^f^xitBii^ 

A major complaint both in Florida and Michigan Concerns the delivery, on tjme, of products f/orn contracled' 
firms Probably delays are more common with large and complicated programs such as those of Florida a'hd 
Micnigan.#Cie to tneir very scope and size Connectictft. which conducted a smaller program, did not r«porl ahy 
propiems With tnetr contracted firms Nor are aii^the delays necessarily the fault of the contractor, last minute 
changes m the programs by the state e^ucatfon agency can cause delays for the processors For some>g the 
aelays, both Ronda and M^ch-gan surmi^d that the contratted firm dtd noj^lWays assign enough staff^at crucial 
points of, the assessr-^ont program, the ftrm.^5 jjxoject direclot^was inv-olv«jd-4n^§evefai {^rogtam^ at the same 
^irTe and delegated details to another p^rsori who was not familiar with the! program Florida found that ev.en 
Withholding payment until del^ery did not prevent the delays To'try to ^olve the problem, Florida's latest 
contract states ^that the firm wili tre assessed a substantia! amount for each Working day beyond the scheduled 
deadline ^or mater ais Rhode Island has followed the vSame route, as noted la Us Request for Proposal for the 
1975-76 state assessmlent program. ' ' * , ' 

Flonda and Michigan also stress the rmoortance of persona! contacts with the contracted fjr^m on a penocjic 
bas'S. rather than depending upon correspondence and telephone calls The personal .contacts are more , 
conducive to sactsfactory results 

Another problem related to contracted firms with ^h.ch Flonda is faced, and which may well be the case for 
other states, are stale laws requiring a stat^ agency to accept the lowest qualified bidder for a contract This has 
m^ant that Florida^as contracted with a different firm almost every year of the assessment program Florida 
vvould.prefeMp^tra.c{ with the same firrh for a three-year penod to maintain continuity and to sav^ a great deal 
of stafMirjA^ach year now taken up with^nstructions to the new firm regarding the program. Such a sl^p would 
r^/^. -.^pecial legislative authorization m^he state 

imunication and Dissemination 

• Misinterpretation anct adverse publicity^ concerning the results of an assessment or accountability program 
probably cannot be avoided entirely, but more ^^fective means must be 'sought to overcome the Jack of 
uaderstahding of accountability and assessment programs^on the part of educators, legislators, and the public/ 
This IS a commuhication problem that apparently is not going to be solved overnight. For instance, a Mjchigan- 
survey of theundefstahidng of their six-step accountability model revealed that only four per cent of the general 
public surveyed was aware of the modehby title, andfonly 58 per.cent of the teachers in the survey 'knew of the 
pr(ycess, yet Michigan haspubhcized its program more than most states/^ Along with the printed wor d/Mfchigan 

r The Public's Understanding of A Attitydps Toward Educational Accountability. Part III, The Observations and Conclusions of the 
Si/perfntendent of f>ubtki instruction {lar^\nQj^;)&nTr\enxo^^6ucax^ ' ^ , ^ - % 



nqvv \^ making addittona! efforts with face-^p-face^e^gs. filmstrips, and workshops to explain the program a4l 
over the state . ' - ^ > > 

In trte report. Developing Uissemin^iton -Procedures for St^te Educational Accountability Programs,"^ 
prepared by Michigan for the Cooperative AccountatHlfty Protect, the problems and-faiiures of communication . 
and dfssemination are documented, and many practical' suggestions are presented for improvement in this 
difficult area One criticism expressed in'the report of-Michigan's early approach to the news media stated that, 
althoug^ routine reports anci releases were sent to the state level media, littte attempt was made to int^rpr^t for 
the local medi^ what the results meant, an omission wHich fed to misinformation appearing in the local press. An ^ 
mterpfetation of the results is necessary for technical, professional, and lay audiences.^ • ' 



Other omissions are pointed out in the Michigan disseminatiuni5tC]Cfy.^7s;[though the State Department bfy 
Etiucatiqrftooperated with.newsmen who wanted to wnte feature stories about the assessment, feature stones/ 
With in-d&pth explanations of the program were not supplied voluntarily by the Department to tfre media over me 
state Also, the market of other specialized media, suchas union papers, church publications. League of Won/en 
Voters materials, alumni magazines. Chamber of ConTmerce bulletins, news organs- of industrial plants^etc , 
were not contacted acid supplied with releases Video and audio tapes for use on local radio qr television/hows 
-'were not Available Michigan now is attempting to strengthen its dissemination program with the help of 'the acT 
hoc committe^e rnenticned earlier that ^as established for the purpose of coordinating and yistituting 
dissemination methods and improvements in communicatton ' , /. 

The pooperative Accountability Project report emphasizes the fact thai responsibility for a gnsse^ftrnatiOn 
progr^-m lies with a state s department of education It cannot be delegated to the^ppess. Cenkal ^pf^naUon of 
a dissemination prograrryis necessary for a measure of success. Sorne of 1his responsibility carjJie delegated to 
the local districts, in the case of Flori(;Ja. district coordinators contact local media and citi^Sf c5ncerning the 




program.. 

Use Of Results , ^ i 

Tod often an a3S,essment program is em&arked upon forpbiitical eii^^f^ies. an6r\o\ enough .mitialthoughtjs 
^' given to how the results might be constructively u^ed. It is^acknowledMd /hat spin-off values have resulted from, 

assessment programs ^ Many more local schools are giving greaf6^ tl\oj^ght to their curncul^ and are working 
through obj^ct^ves Assessment programs that test specific skills of publls from a student outcome point of view 
are having an •^ffect'^'upon local school testing, but a great deaPmdji^e can be^done with the results of an 
assessment "prdgram than generally is the case Cor;p€ctive action should taken, needed oliahg^s made,^ 
educational alternatives offered!, and evaluations/tonducted frank Wom^r, in another Cooperative Ac- 
couniabchty Project leport prepared by him for Minnesota entitled. Developing A Large Scale Assessment 
Program,'' has offered a considerable number of suggiestions for the constructive use of assessment results as 
well as methods for com.municating them ' ^ - . ' 

- fn order to increase the changes, of the results of a program being utilized, Womer points ouMhai J ^^ee 
'i*rr..portant stepst among'ottif^rs, ar^^necQssary beforethe assessment.prpgram is devised The gist -Of these pteps 
can be stated as follows.^ * ' ^ .* ' ^ ; \ 

\0 Determine the mapraudience or audiences for^whtch the program IS designed ^ / 

• • Focus the assessment from the beginning on^specific pu(pos^s and list specific objectiyes or goats ol the 
assessment program that w;lt rebate tojthe expressed needs of this audience. ^ - 

MaKe clear to thexnapr audienG66*,t^'at the implication of the resultsof an assessment program is tO'bring " 
about positive change if .they ^oXot'reach"^expectat!Qns at any point^lf the results warrlant the reallocation- 
of funds ^nd staff, new^and alternative programs, or th^distributiSn of other resources, this action*should 
taKe place or, at th^ l^ast / fhe basic foundations for such 'changes sfiould be put'jn'to effect. The mere 
. publicaiipn^of'resul!s''does r>ol necessanly bnhg about change. Someone mgst be responsible for^^eing 
' " ^ ^ tnatcnangelaKesplacfe. ' ^ , , , 

. ' {n {egard to Ihe rVst po.nt, it is necerssar> to'determ>ne mapr, specific audient;es as the prime targel for the 

assessment program and to ma^e' clear in the assessment reports that the progr^rn is directed to these 
- auajences'in particular, this is^ because no one type of a^ assessmeht progr^ can ehtirely satisfy all audiences 
< and groups who see the reports-. Assessment results.tn most states generally are distrit)uted to a vanety of 

' ^ ' * ^rwin P Belttnghaus' Sr)6 ^Gerald R Miller. A Otssemmatton 3y$t^m for Stale AccOimtamty Progmms, Pari ///, Developing 
*' Diss^tnation Procedures for S/afe Educatior^gt Accour)tabihty Program^ {Lansing. (Department of Educatioh, June. 1973) 

• fiiranKB Wbmer, Developiryaa Large Scah A6$e$$rrientPrograih {Der\weT, 'Cooper8\WeAcc^^^ 1974) , pp, 81-87. 

. ■ ; ■ •. ■ ■• ■-■es- r 
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persons— legislators, stale^ducation agency decision makers, ellucationaf organizatfdns of all tyfJes, teachers, 
parents, stu€)ents. and other tey orgarwzat^ons and groups. It \s financially unfeasible and too time-consuming 'ti> 
devise an assessment that provides ,^ach one of these audiences all the information they may vyish to have from 
thetf own points of view As Womer states* 

" ' « ' . ' ' - <i ♦ - - • 

A multi-purpose assessment program that ^s desigried toTneet the needs fcir educational jnf or matJbn of 
- person^ at afl levels of educational decision making runs the risk of not really providing the information • 
that IS ma>rtmaHy useful for any one of t+^em^ ^ y \ 

In'regard to the second point, the purpose of the assessment and fts objectives* should fcfe ge^red to the needs 
of thf major audiences selected to receive the/results, and' these needs should be limited to .the rtiost vital: 
educational neecjs at the time of the assessment. Womer suggests that examples of aiternative repooa: designed 
in di^ferpnt ways, be prepared to illust/ate what partiQular audience^ can expect fro/n an issessmfnt. In ^his 
mannaf, anaudiehce can choose which type of report will be the most Oseful to it, a program can be dJ/ised and 
' Its costs determined. / ^ ' • . . , r *^ 

' In regard to the third point', if a commitment to make improvements where necessary iS hot heeded or carried 
out, there is no pO}nt in spending thous^mfs of dollars and substantial staff time ingatherihg data for information 
purposes only . . ' z .'^ . ^ ' 



Colorad<3/ References 
State Agency Representatives 

■ ^ ^ « . - . 

Slanley A ileftwich, Assistant Oommissione: 
State Department of Education** 

• * 201 East Colfax Avenue . 

' Dejiver.vCoforado 80203 . . 

^ .Kathryn DePew. Consultant . 
PistriCt Planning and Accountability Services 
State Oep^rynent of Education ' i 

* 201 East Colfax Avenue 
Deliver^ Coloracio 80.203 

.Leonard P* Landry, Directof ' ' 
District Planning.and Accountability Services 
"State peparlment of Education 
201 East Colfax Avenue 
. Denver., ColoragJo ^0203 

' Dr ArtlprR Ofson; Project. Directoijk 
Cooperative Accountability Project 
136i2 Lincoln Avenue 
. *• Deinver. Qolqrado 80203 



LEGISLATION 



Title ^. Aft'Cfe 7, Colorado Revised Statutes, 1973, Educatipnal Accountability Act.of 1971 Denver Colorado^ 
Gener-al Assembly, 1971 . ' 

^ . ' . ^ - ' . / t , ^ 

This law IS Colorado s'comqrehen^fve accountability act enabjed in 1971 which .requested goals and 
p-enorrtie'nce objectives at ll^'^iaie and fo'Cai distribt levels; and i means for evaluating: ilie aqhieverhenls of 
educational programs and their impact upon student le^'arnitcVg , ' . . ' 

T/?/e 22, Article. 44, ParV2i Colorado Revised Statutes, 1973, Financiar Policies and RrocecJures Act Denver. 
CoioradoCieneral Assembly, .1973 , ' ' f . * ^ ' 

This Abt repealed theVrogram Planning. Budgeting, and Evaluation •Systerfi law o%1971. The bill caJIs for a 
program-priented bqdget forrfjat wl^ichr will relate anticipated^costs and actual <;osts to designated programs. It^ 
istobeimplemente,d by 1976.^' , ^ * \ . \ " 

• Ruleq. Educational Accountability Act of )97M7er>Ver. Department of Education, 1975. 

Tne Educa'Kona) Accountability AcJ pi 197^ mandatecl that the State 'Board of Education adopt rules an-cf 
regulations to carry dul the directives in the Act- This set of revised RulesVajS adopted by the State Board in July, 
1975, an^ it reflects how the Jaw will be implemen4ed,as interpreted bythe.Stale Board of Education, the St&te 
Accbunla«bilUy Advisory Committee, 4nd the ColoradorDepartnrent Edueation. 

EduCATIONAL GQALS *^ : ... * 

^ducatfbpai^als for Coloradd Qtizeps^ Denver: Department of EdL/6ation, February, 197L . 

••Thts'brdchure containsMearne'r pulcome.educaHor^^goals ancj/^brdad pbjectives\(subgoals)f adopted by the 
Colorado State Board of Education in February, 1^71. ^ 
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P'scez^:^e Df'\-'*'op'rfy^: a^r^ Aaopiioc.j*f Siatt Goais for Educa^ or I'V 'h/h the S*ate of CO'OradQ Denver* , 
,£>^^s;.>oG^J5 3^•;:c^c•''^ J J^e^ \'5j:^ca:o^ 'r' 'ne y'ni- xCo oxalic De^*^e^ Oeparirre^: of E'ducaijor ^i974. 
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ACCOUNTABILfTY SYSTEMS. MODELS ' 



\ - 



" e-: r a:c^b a- j f\e ecu-ca^c^?- ^r^^ aa:-/ s "^^^4 ^e^jo.-^* ^as of n-;a;o^ S'Q'^ '-^car-e to 'f^ 
C : ^'-acc Ezs^za: o^a 'Acr:..":ar ?/ Ac* ^97 * as r^an-» of •.''e-'-deas repc:* we^e • 

% ' ^ ' ' . • * * 

. - - i 

S'a:- E.ar J Ej^^a* s 'C-ar'e-d ;n{?£G^ca- :"'a A:Cc^r-»aor-t> A^:' o* 1971 lo repon ar.r..,afiy lo tne 
C:- j^-^icic As^e'^t , "^e c'og^e5^'b"^^T.p,e""en*;rg "-p Ac: Tnis report descfoesthe^r:! a{ qnases of 

.-V ' ^ a"'0..';c ^Des sec: c* ^zr {'-e ^ese.c^r^^^'^t aro a'^n^ ^ '^■at'on o-:ha orogr^ni a statics 'epon cf 

- zr- y ic^-eve-e"^*^ *: oate a"\: a -eccr-^eraa: 'or :r.e LebiS'ature Loca^ cstnc* p'-ogress ir> 

- f^^Oi^s^ • ^. -^r-a a::-.^^'at:. cc'^'^viees a-.o stavjs ot d'Si^ ct eaucat cnai gcais era oo-ec^^ves a^elne 
;Tr5 - e.e--:^ :■ ^.cT-^ssec: T'^- ':e o' 'se S*a'e Acccj'";aDr Acfvssc'v Con^V-iuTee ar'a me rules ar)d-reguta::cns w 

— Act-Bre^r^c-.-^c-?^ — - ^ - 

- , .v^^" :_.zn :-e c^-- ^ :^a* -'e^- u^a--'*aKe' '"^^e \vj' ;m^1erf^<e'^.'! r.g :ne Accouriao '-Vy Ac^ of' 
Tcevj' rf-s '^e ac* v-*^s c'^^'^-e Siare 9eo2->*' v^^'* Ed^ca-*'0* and ;ne :cca' a's:''C[| as :ne/ 



Tr:s s •^e^sei^ord.'epc** cov^aec: »:^e* State Board gf cducaHon fdr the State L^gtsiature cov^mg the 
';-:xe>3 ;r/.r-icie^^n:'ng t*^ Accoji^tab^jt) Vac: of 19^1^ it *iP(^ca!es ine sta4Js of .the'loca^ distngts m ^ 
■rspre-r-e-^t ng eacrw o^ ':ne*r?^ree; ac6oun!ao*u!y pnases. Thfs^s^iuues n^e estaoi.snmenf^of loca^ advisory- 
ccr'r.^'tu^^z • ^,r,y^^r. -ecor-^ or ^ecorrri'^eriaatjof.t^ tor iccai Doards ot eaucation. goaJs, staU and siudeht, 
pe-*cr"-a'~ce oc^c-cvesvp'ogra^r- cnanges cased on'ooi^r^ves andotjpM needs compuiattor^^o* progrVm ccsiS.' 
ana su.0^1 .cier'G'^ance indicators RtccJrrirnen^jatrons addresseo'iG me'Coioradb State Legislature aiso are 

Surrm^ry peoc'i—SeccT'C! Ann la' 'f^ort tne EOii^ttona' Accoun^^^^ W71 Denver* DecaMrneni^ 

otEd-jcanc^Ai^bruary 1973 

Tnts -s a-^uiT^ary of the second report of the State Board of cAicaticnJor ^^^e State begtef^ture or the' ' 

TfT^iementation^tneAccoyntapiiity.Aet ol 1971, - ^ ! * • • * 

_ .^^^^^^ ..^^^^^^^^ ^_ ._„_^„._^.„. 



Third AnnuaJ Report on the EduchtQnal Accountability Act of 1971 Denver Department of Educaltoh. 
Feoruary. 1974/ ^ . \ . - ^ ^ _ . 

Tp^ \s the third report provided by the State Board of Education for the State Legislature regarding 
/mplementation c' the Accountability Act of 19? t It covers the period from July, 1972, through June, 1973. 
^ Resporfses from the Oistncts to open-ended questions include means of measurement for gathering'data: local 
district reports- to their (immunities, cost efficiency, educational decisions whjch would affect .the quality of 
i nstru ctT o n a l jDrograms. And difficulties encountered aryj forms of assistance reported as rn&^^useful in 
overcoming the difffcuitils Tables show the progress of the local districts in conducting needs asses^ents an9 
their purposes, "updatecfcoals and their publicatjon; procedures for develot)rrient of, student and stair objectW^s 
.and the percentage of^hool drstncts involved in this step; extent of change in progVam cha^&^erist»cs and 
^ degree of assistanc^ircetved by the districts from the Department of Eaucation and other sources. - 

BacKground and impierrenranor Procecures fo^ Educational Aqcountabihty m Colorado Denver: Department oi 
Education. August tO. 1^2 * ^ - T 

Th's^ paper presents a discussion of the meaning cf accountability \n the Cobrado Accountabiljly Act of 1971 
^ aro a review o' accountability progress m the stat^ Pro|:)lems and issues rel3Sng to the role o1 the State Board of 
Education ./^ 'mplementing the Act are Described, and suggested solutions are provided. 

DePew. Kathrvn 'Accountabilny AcNevement and Goals/* Education Colorado, Vc' IX, Nfp 8 Denver' 
Departrrientcf education. April 2. 1974 

The Chairman of the State' Accountability AovisoVv Comm'ttee explains how the Accountabif^ty Act is bejng 
'mplemented, the policies of tjfc State Accountability Advisory Committee, the methods being used to^estatMi'sh 
accojntaDtifty programs \n\hf^nca\ districts, and the accomplishments and results that have come about - Some 
ot>;ective^ thatV'il be put into op^tion in thcjfuture also are discussed ^ 

pePew Kathryn Art-cle ^Jnt^^led) to appear ip the Colorado Sch&ol Board Bulletin Depvof Departfrjent^oi; 
Educat'On. Nfovember. 1974. ' ' . ' ^ 

The objectives of the .State Accountability Advisory Cor^mittee for the operation and establishment of local 
district- accountability orograms are summarized A progress report of the accompi'shments of the ajr^-en: year 
and what is planned for 1974-75 are described 

Fourth AnnuaTPefiort on the Edacat'onai'Accouniabthty Act "of 1971 Denver 'Departn>en! Education, 
Februa/y. 1975 . ' ^ > - ' ' - 

• Tne report ts'an abstract of the information prc^/ide^ by^t^e local school distncts to the^State Board of Education 
on their ^ctnnties fr^i Jufy 1. 1973throug^vJune 30, 1974- The progress of the local districts and therr concerns 

^ are documented, as welfas recommendaltons for further Departnr>entof Education assistance to the districts ^n 
the.developmentof their accountapility programs. . * ^ ' ' 

Supplement to , the Abstract Op.the fourth Annual Report' on the Educational Accountability Law of' 1971. 
Denver Department of EducatiV', t975 - • 



* This is the second 'portion of th4Fourth Annual Report which contains more^teiied information on the progress 
ajld concerns of the local schobi dislrtcts lo the ^development of their accour^fgJDility programs Tabulations and 
bar graphs are included, ' * - - ' " " 

ASSESSMENT AND EVALUATION* 

Procedure JorEvakJStibfrWf thin the Accountability Process. Denver- Department of Educatioh, August. 1^4. 

The Accouotafeility Act of. 1971 direcjs that an eValiJ^^JOn ,meGTianjsm be developed, fo measure, the* 
achievemertts and ^rtormancS vl slud^ts. -The design of the e^luatiOr> procedure waS comptete^ b^ 11^ 
Colorado t5ei^dr^eM.oi Education and thp State A4i;;ountabUiti< ^bvisory Cdmnrwuee ,^nd wds presented for- 
State Board'approvalttn May.; 1974: 'this paper jJfesents the pr^^ptj^Bbr^whtch suggests stejisMhat the-local 
cfetncts mTght;^3keMn devlilopioga pixxedure for e\{a^uation;bul aJloWs3he4ocar dislncts to deyelop'lhe actual 
des*gnf6rjhetr evaluation procedures. ' * '* • ' .V* * . ^' 



SCHOOL ACCREDITATION / 

' A School Improvement Pfocess. Accreditathn by Contr^^^ Denver Department of Education, June, 1971 

This publication presents an overv.ew-of the cor^cept Qf accreditation by contract as proposed by the Colorado 
Department of Education: It explains what is involved m comprehensive educational planning and contract 
accreditation and identifies the procedures necessary for the local distncts to implement^n order to achieve state 
accfeditatidn by contract . /* r • ^ 

Accreditation olColorado School Distncts Denver. Department of Education. January. 1975. 

This ^utjiication gontams the rules and regulatio^(s/for t^e accreditation pf school districts by the Colorado 
Department of Education. The rules and /egujations cover two accreditation programs* (1) standard 
accreditation, and (2| accreditation by contract It focuses upon the total school'system. kindergarten through 
jhe twelfth grade 

FfNANCIAL REPORTING MANUALS ^ 

♦ . .* » 

" Financial Pdifoesan<lProcedi3fesHendbook Denyer Departmentof Education, January. 1976 , 

This handboo1< was developed jn compliance with the Financial Policies and Procedures Act of 1973. It will be 
used as the offiaa; guide for Coloradd public school distncts prior to and following the development and 
' implementation ot a ^fmanciai accounting system. Budgeting and reporting requirements^ are shown in the 
handbook Theinandal policies and procedupes-will be a subsystem of a total management information system 
that incorporates-Dudgeting and accounting data with pupil accounting, staff accounting, curriculunn instruction. 
- pro'pertyaccountu^g.andQommunity profiles * _ 



Connecticut References ' 
. - State Agency Pepresentatlve 

Dr.lSeo'rgeKinkade . , . 

Director of Assessment . * ' • * 

State Qepaclment of Education - ■ ^ 

' % State Office Building , . , * " ' % 

, Hartford. Connecticut 06106 f ^ ' • * 

LEGISLATION . • ^ 

PubhcActNo 665. 1971-(Ti}le W,Conn Gen Statutes, S 4) Hartford! Connecticut State Legislature. 

This Ac^ mandates the State Board of Education to develop an evaluation and assessment procedure for . 
^measuring objectively 4t)e adequacy and efficiency of the educational programs *ff ConneCticpt^B public schools. 

ASSESSMENT AND EVALUATION ' .v., 

Connecticut Re^dtng Assessment 1971-72 H^ford: State Board of Education, no date. ■ ' 

'This repo*^ sommanzes the assessment of readir^g perfofm^^qe of a'sam0hng of 9-, 13-. -and tZryear-olds m the . 
Connecticut public schoofs in' 1972 ComparTsons are made with National Assessmert'i of Educational Process in 
X\)e northeast, by sex, and by size of cpmmuniW^NAEP test instruments syere used and adapted to Connecticut ^ 
*oTJjecjrves'^fperfbrmaoce objectives in reading were tested..- - 

Report on the Assessment ofReadtrjg Skills of ConnectiCuf^bUc Sc^ao/^fuden/s -Philadelphia: iRStitiste for the 
Study of Inquiring Systems, no date. . , 



T^.+s 44echnic^, deta+i€jd^iepof4 f>fep0fed^_th^ i^ntracto^ of ihe as^ssmeot of readmsrskrHs-perfooned^fn - 
1972 in tne Connecticut public schools. It contains information about^he^veJopment of obj^lives and test 
instr-uments-to measure them, pretesting, sampling procedure used, adminislration of tests and admftiistrator's 
instruction^. cdt>jes otmailings to superintendent and principals invoiviRg instructions;' data anajysis methbbs 
•^Q^results. The results include the test iternsjtised and compansdns mao|S wifh ISIAEP andjoeffOfial (northeast) 
resuTtvby sex*, and by size of community > . 



\Evaluatipnsana Reports As Mandated iytheGenors^ssem^ly. Hartfcyd: Department of Education, February, 

A orogram evaluatiOQ is present^ in response to»tne requirements of the Connecticut General StBtutes, The 
requirements of each statute are noted.- 'and the major program evaluations cdn^in the objictives of 'rtie 
ptMram, distribution of funds, need for .the pi^ogram, performance indicators, impact of the program, and 
r£c^?5??^datTons, 

EDUCATIONACbOALS * V ^ ^ . , ^ • * ^ ' - 

I ■/ >* - , * ^ . 

Cftizen Survey Forms. Hartford Department of Education, 1972: . ' \ " t 

• - • - ^ • - ■ ' ' ' 

These are copies of citizen ^rv^ forms, short and long, for obtaining citizen opinions on pcopo^. tentative ^ ^ 
goals. J ' . ' . ' * 4 \ 

Connecticut Citizens Response to taucaUonat GoBls. loy-^p At>fidy^ H^ftfordT State Board oi , • ;> 

Educatton.no date. ERIG ED 078 045. ' / ' ^^^ -^ , . 

This fs a summary feport, foe public conswmptlon/oif the s<63y,made 1o determine puWlc cesf>onse to possible 
goais o^Ciwjnecticut edpcanorr; carried out In conju^Clftn and s<aMtane9u§ly y^iih the Connectifut^Reading 
Asse$sment«n 197?. Thererare SJX.main.goalsdnd S/subgoats. A t;>r^f d^Vtption of the j^oceddre us^ and an 
analysis of the re^>onses^e4)f5^ ^ * . ' ^ , 

J':2l..::. ' '.i. :m-..;..:^.J...... v:l:L "l"i.: 
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Connecticut Citizens Response' to Educational Goals. 197 1-72 -Philadelphia' Institute for the Study of Inquiring 
Systems t'tSfS), no date €FltC£0 078 045- ^ - - - -- - 

This IS a detailed /eport of the study conducted in 1972 to determme^publicresponse'to suggested educational 
goals and subgoais. Prepared by ISIS, the report contains background of the stucJy; development of citizen 
response instojmentsi distribution of in^tru1=nents arxJ characteristics of respqndeats; mfethods of artalysis; and 
remits in ord?r of importance. The Six pnncip^fgoais have been accepted by the State Board as working goals 
and are learner outcome goais. * • • ; ■ ' • * ^ 

^Connecticut Gvzens Comrpents on Educational Goals, 197 h72 Philadelphia- Institute for the Study of Inquiring 
Systems, no date ERIOED 08 1 804. " * ^ ^ ^ 

' Another section of the ISIS goals study for Connecticut rn'which its citizens were invited to express their opinions 
about the educational process of the state This report presents an analysis of their commits 

PPBS< PROGRAM PLANNING & BUDGETING SYSTEM )' 

--AV^ivg Paper for Evaluation Reporting Hartford Department of Educaftion, October. 1973 Outofpnnt 

Connecticut' has instituted a PPBS for budget reporting to the General Assembly and for evaluating all state 
department programs Th^^ six mam pupil-oriented goals listed have been accepted as working goals by the 
State Board oftducation and as the basis -for ttie development of detailed objectives for the units of the 
Department PPBS goals have been adopted that describe m general terms the responsibilKies of the 
[department and its proqrams 'which wilt contribute to stuctent achievement of the 'pupir-dnented goals 
Departriental goals, with accompanying program^ objective^are presented m one section of me report; anothej 
, .section presents departmental proijrams wit^h objectifies aocffnd^pators . • . . 

Pre//m/naryGoa/s5rareme^^'Hartford-DepartmentofEducatIQn, June. 1974. , • ' " 



This statement presents the gbals of the State Department^of Education for imp^g education and discusses 



yvhatt heeds iojoe dqne to aU^!?\efri- 



This (document indic/tes the tasks and activities of alt Department pf EducaliOn administrators which 
contributfe to the att^nment'ol five Department - 



Mission for 1974-75 Ha/fo'rd. Department of Education. July 23. 1974 





" Florida References 
State Agency Representatives 

• . . ' * Ms. Judy L Haynes 

/ Assessment Coordinator 
State Departcrienf of Education 
' Tallahassee. Tlorida 32304 

LEGISLATION . ' - 

Title 15, Florida Statutes Annotated, S 230 23, 1970 lallahassee- Florida State Legislature, 1970. 

This bill authorrzes the Commissioner of Education \o develop evaluation procedures for^ state as^ssment 
program,and to make a preliminary report to the State Board of Education and the House and Senate Education 
Committees by October 1, 1970 

Title 15. Florida Statutes Annotated, S 229 57,2974 Tallahassee Florida Slate Legislature, 19^4. 

This bill amends the Educational Accountability 'Act of 1971. The amendments indicate that testing of all 
studeQts tn grades 3 through 6 is to take place by 1976, No ottier subject areas are to be tested until the 
assessment of grades 3 through 6 has been <;ompleted Statewide results are to be compared to national 
indicators of student perfornsance. An interpretation of the results for each school is to bQ reported in the annual 
report of school progress. ' 



EDUCATIONAL GOALS 



Goats for Education ^R^FiQ^ida Tallaliassee Department of^Education* 1^71 ERICBD055048. 

This article presents iearner outcome ^nd orgarnza4ional goals of the Department-of tducatfon whteli w^fje 
adopted by theStateBoajd of Educatipn in April, 1971. 

r 

ASSESSMENT AND EVALUATION - •-■ ' ^ • ' ■ 

. Plan for Educational Assessment in Flonda Final Report. Talt&hasse?: Department of Education. 1971 

Thisr plan for educational assessment. and accountability in Florida was submitted to the Siefe Board of 
. Education and>haLegisteture in March, 1971. by he Qommissione'r of Education, as mandated by legislation. It ^ 
describes three phases pf the model: product assessment; cost analysis, and process assessment. Norm- ' f " 
referenced apd cnt^nqa-referenced tests are defined. The assessment plan, which is part of«a lacgerplan f or 
* evaluation 'Of ^ the educational syst.eni, is summarized, and pVocedures arejdescnbed -for cteveloping goals, 
performance objectives, and pbjectiveftreferenced tests The report contains a full explanation of mult»ple^matffx 
sarhpling to beijsed in the a^^ment of reading in 197 1 . It includes lest administration pfocedu?es, how results 
will be reported, andlheaudieace to whorT3|heresults will be directed *' ^ . ' 

. • \ • • ' 

7^/^a//?eporr on Srafevv/cfeAsse^n^enf. Tallahassee; Department of Education 1^72. " 

-Tl>fs-is a^narrative summary of the background and vanous' activities of the Roricfa Staftewide -Assessment 
Program, Information' is given op prejesting of assessment ^^rocedu res, test devetoprnent; analysis 6f reading 
instrun^ents.^dissemmation of 'information about the assessment; and mandQement .and planning alj^e^cts. 
,Severai< attachments are included, among which are a discptsion of how results will be reported %nd a list of 
;i ^7 1-72 high priority objectives for reading in Florida for students ages 7 and a. ' .\ ' 

• Flonda Sfdtewide Assessment Program r^Capsuie Report. 197 Tallahp^: Department of Education 

. This IS a,summ)ir)^-fepcyj of the 1971-72 kpy^^^ults and Wcommendaitons of th^Jourth grade student 
^ performanqe on the assessmenf of reading^. " . - ' s 

' \ ' \ ♦ • " ^ * . ' • 
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Flonda Statewide Assessment Program — Technical Report, Section 1, Introduction, Procedures, arid Program- 
^ RecOTT^nendaPons, 197 U7^, Taii aha s se e: Department of Educattoftr - - - 



The report of the Flonda $tatewide Assessment Program performed in the*1971-72 school year for fourth grade 
reaiding is published in four- sections. Thg is the first section which giyes the background information of the 
program, the design of the program/and The responsibilities of those involved in the assessment activities. One 
chapter presents the procedures used in the assessment, specifying th^ selection of statewide objectives. 

, testing population, selection of a random sample, test development, test contents, test validation, test format,. 

'administration of tests, test sconng, and recommenojations on the program operation for improvement of jh^ 
procedures for future assessments. - ^ 

FIdrida Statewide Assessment Program — Technical Report, Section 2 Statistical Information, 1971-72, 
Tallahassee. Department of Education. ' . 

; The second section of the Florida Statewide Assessment Program ts a technical report which describes the itenrv 
sampling and student sampling procedures used (multiple matrix sampling) ; problems with scoring and how 
they were resolved; bow results were reported and the types of tabres used: an explanation of standard error; , 
. and how district scores should be compared with state scores. AppefWixes contaih lists of reading objectives for 
age, 7 (grade 2) and for age 9 (grade 4) ; statistical formulas used for standard error and for weighted district 
percentage of achievement; and tables showing 68 % confidence intervals for each objective for the districts arftf 
thesjj^e^^ 

Flonda Statewide Assessment Program — Technical Report, Section 3, Statewide Results andRecommen^a-'" 

• f/ons. ;97/-72 Tallahassee: Department of Education. ' / ' " ^' 

The third section of the Florida Statewide Assessfhent Program explains the classification oi the objectives in 
/ order to present the results in a meaningful way. defines each classificationi' and iricludes a sampl^ itern with' 
each classification The results are presented tor grade 2 and grade 4,< along with interpretations prepared by the 
state reading consultant. ^ 

_ Florida Statewide A^essmehl Program ~ Technical Report, Section 4V District merpfmtionsrCtrartotte ; - 
Coun/y, 797 )-72.Tallahassee:"Department of Education. ^ - 

District. thterpretations were prepared for each school district in Florida o\ the results of the Florida Statewide . 
' Assessment Program. This fourth s^tion is an example of a district report for Charlottfe County which helps the 
' ' distnct analyze the performance of their second and fourth grade students. Tables of results, interpretations, and 
recdsmmendationsforirnprovement of student achievertientareprovided. ' ; * ^ 

r . Florida Statewide Assessment 'Program, 19/3-73 CapsuleReport, Tallahassee: Departmedfof Education, 1974^ ^ 

This report summanze%the key results and>recQmnr>endatiohs of the' state's perforrnanpe in the 1972-73 . 
, Sjiatewrde Asse^mept Program for' grades ^3.- 6. arid 9 in.readmg, yvritipg, and mathfematica 'Objedtive- 

• referenced. instrumer^ts were used. A verbal summary'is given of the results in this' report. The basic reportino 

• format utilized is!the percentage of students in the sfate ahd each district who achieved each obj^ve. These 
percentages are given in separate sections of the Technical Report, annotated below. . * 

Florida Statewide, Assessment 'Program, 1972-73 Technical Report,^ Section 1, Assessment Procedure?, - ^ 
Tallahassee: Department of Education, 1974. * • ' 

' . This repbrt contains the procedures u^ed in Florida's Statewi(^e Assessment f*rogram conducted in' 1972-73 for - 
' ] grades .3, 6', and 9 in reading, writjng,^ and mathematics. These include choice of design; contracting; 

development, setection, and evaluation of objectives; test development, contents, format, and test^administra- 
- bon; validity and reliability of the tests; testing populationUnds^^ ' . '^'^ \ ^ 

* :> , Florida StatfvitdeVAssessmem Program, 1972-7^rechnical f^eport: Sectfo?) 2. Pffority Skills ar^Sta)ewide^, . 
N * l^esuttSi Volume B — Gracte 6. jailahasseie: Departrftent of Eduoation, 1 974. ' 

'\ • . • . ' , * 

The results-^of objectr\;e-referenced testing dt approximately 19,500, students in graders in March, t«73, ar^- 
reported in terms of thep^centage 6f sftudenfe in each-district in the state who achieved each o^)jective. Priority 
' -objectives* for grade.fi (age 11) for reading, writing, and mathematics are prpvided fn,the Aijpendix. An ' 
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Florida Statewide Assessrrient Program, 1^72-73 Techr)jcaf Report, Sectior) 2, Priority Skills and Statewide 
^esu/fa l/o/umeC — Grades Tallahassee Departm^t of Education J974 - . ' 

The results of objective-referenced testing of'approximately 14,500 students in gratfe 9 4n February. 1973^ are 
reported ir) terms of the percentage of students in each district and in the "state who achieved each objective. 
Priority objectives for grade 9 (age.t4) for reading, writing, and mathematics are provided in-the Appendix. Arr • 
interpretatior> of results is included. - ^ . 

Fimia Statewide Assessment Program, 1973-74 Technical Report, Section 2. Priority Skills. Volume A: Grade - 
3, Reading, Writing, and Mathematics, Tallahassee: Department of Education, t975. 

This report presents information about the kinds of skills assessed and the types of test items'ysed for'the 
objective-referenced test.ing of grade 3 iriFebruary. 1974 A short background of the assessment pro-am and 
the procedures used in the^973-74^assessment are provided Pnority objectives for re^ding^ -writing, ^and 
mathematics lor grade 3 appear in the Appendix , ' , " 

fionda Statewide Assessment Program. 1973-74 Technical Reports Section 2, Priority Skills, Volume B: Grade 
6, Reading, Writing, Mathematics, and Science. Tallahassee* Department of Education, 1975. . * ^ • 

This report presents informalion about the kinds of skills ^assessed and the types of testjtehns used for the 
objective-referenced -testing of grade 6 in February, 1974. A short background of the assessment pFograrh and • 
the procedures used m the 1973-74 assessment are included. Prionty objectives for reading, wntihg. 
mathematics, and science for grades apppar in the Appendix ^ ^ 

Florida Statewide Assessment Program, 1973-74 Technical Report, Section 2, Prionty ^/c///s, Vdlume C: Qrade 
9. Reading, Writing, Malhematics, andScience, Tallahassee. Department of Education, 1975. 

* ' / ^ . ' / ^ ' • ; • » 

This report pr^sant^l^roTmation about the kinds of skills assessed and the. types of test items used fpr the ' 
objective-referenced testing of grade 9 in. February, 1974. A short background of the assessment program and 
th#procedure$ 6sed in the 1973-74 Assessment are given. Pnbnty objectives in reacimg, writing, mathematics, 
arKiicience for grade 9 are included ir> the Appendix. I - > ' ' , 



FlorCda Statewide-Assessment'Program, 1973-74 Techpical Report,' Section 3, Statewide Results, Volume A: ' 
Grade 3, Reading, Wriimg, and fAathematics, Tallahassee:^Department of Education, 1975. 

Thts/eport analyzes the performance for the state as a wtiole.in each subject area and interprets the results of 
1he^ February/ 1.974, ^ssfessment of grade 3., A ^hort background of.jhe assessment 'program and 19-73-74 
pr4:edares are included..SdTne compdnsdns are made with 1972-73 achii^vement results. Priority obje'fetives in 
reading, vyritmg, and mathematics fpr grade 3 are provided in the Appendfx. • • ' 

Florida Statewide Assessment Program, 1973-74* Technical Report, Section '3: Statewide Results, Volume Bf 
Grade 6, Readin§7Wrning, Math^^ ' * 

This report Shalyzes the performance for the state as a Whole ir> each subject area and inTerprets the results of • 
the FebVuary, 1974, assessment of grade 6. A short background of the-assessment progranri and the 1973-74 
procedures are included. Some comparisons ^ith 1972-73 results are provided. Priority'objectives in readrng". 
wrrting, mathematics, and science are given in thyb Appendix.- , , „ ^ ^ / 

Florida Statewide Assessrpent^Prhgram, i973-7A Technical Report, Section 5, Statewide' Results, Volume'C: 
Crade9^,'Reading, Writing, Malhemattc^, and Science,7a\\aha^e:Depar{men^ . 

This.report analyzes the performanfce for the state as a whole in eaph subject ar^^ and interprets the results of 
the Fe(^rliary. 1974. asse^ment of^rade.9. Some con^Visons with 1972-73 results are provid^d^ A- short 
background of the assessment progranri ar^d the 1 973-74 procedires are ihcluded. Priority objectives ih reading, 
^writing, mathematics, and scief)ce are ^iyenin'the Appendix. ^ < ^ n , \' * i ' 

j/or*<te Statewide Assessnnent Program, Qijide to District and School ^Assessment Results,, . 
iHahassee: Department 6f Education, '1§75. » ' * 
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ThiSreRort^descritwlhe infomiation provided' in tbe tables of tesults for each district and School ih the^^tate^ 
grawS'S. 6, and«, wifeh partfcipated m the statewide assessmeat program ir^ reading, writing, mathematics^ 
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and science during 1973-74 An overview of the 1973-74 assessment program ar>d a brief summary of teclinical 
information needed to understanS the'tables of results are included. Approximately '•112,000 Students were 
selected for testtng * ^ . . . * , . , , 

Haynes. Judy L. and Crane Walker. Operating An ObjecUve'Reference Testing Program. Florida's Approach to 
. Large-Sca/e>4s5ess/7?enf, Tallahassee' Departncsent of Education, 1975. • 

This informative report is a puiplication prepared for the Cooperative Accountability Project by Florida, one of the 
member states, of 'the Project. The focus is on objective-referenced testing, ar:id the papeHjescnbes some of t+ie 
develppmental.procedures Florida has implenjented in the last three yearsJccludedaj^ subjects _thaJAake_u 
procedures for' establishing goals and objectives, contractin-^g-, .training Of persons involved in administering the 
assessment, and procedures for atoimstration and scoring. An appendix containing technical specifications for 
objectives, test items, assessment exercises, test construction constraints, and field test specificatiorxs is 
•included- Several helpful suggestions on the development of assessment programs are pointedout. 

» * 

KeTly, Jack Assessment Moves to Censusjesting." Reprinted from FJorida Schools, October, 1974. 

This aVticle discusses the change from sample testog to census testing in -the Florrda'Statewid?i\ssessment 
Progcam, as mandated by the 1974 State Legislature in the amended Accountability Act of 1^71 The 
implications of census testing in terms of repoVtjng the results is discussed, and a repltcatipn^of the 'NAEP in 
reading and mathematics, whictt Florida is running for 9-, 13-; and 17-year-olds is described The amended Act 
also requires a comparison of state performance with national perforrnance, and the NAEP replication complies 
with this request. . ,^ * ' , ' " ^ 

'ACCOUNTABILITY SYSTEMS; WIODELS • ^ 

i\ 

Articles on Educational Accountabtiity In Unmrsaf English. Revised ed Tallahassee: Department of Educ|ition, 
February. 1973 * ^ . ' • 

This booklet.^. vyntW^ in lay ternr^," highlights the several-approaches Florida is taktng to carry out its 
accountability planJffl includes ''activities of the^Department-of Education and the logal districts^ with major 
adrnlnlslrative respohSlbimy at the State level, an^ activities supporting^ accountabtiity earned- out t^y theloeal^ 
school districjs.^ Other articles are concerned with techniques to further accountability that presently are being 
• developed by the Florida Educational Research ar>d Development Program, administered by the Department df 
Education' ^ \ 

STATE BOARD, DEPARTMENT OF EDUCATION POLICIES 

The Role of State Government in Education. Tallahassee: Department of Education. (Policy paper approved by 
'Administrative Couripil on May 6, 1972 ) 

This 'paper *cites constitutional and .statutory pr6vifeiOr)Syf6r public education; inherent expectations and 
constraints, and lists nine state -responsibilities of tl;ie sta[le role in education. This is the first in a tnlogy of 
Department of Education policy papers. f ^ j . - , 

Education Benewah The Florida ftrategy. Tairahas?ee: Oepatrtment of Education, Mayfl, 1972. 

The ^cond policy paper of tfie Departn>ent of Education is concerned wit+i the Ftor^Ja Strategy of educational 
. renewal, which includes ajl activities, directed toward identifying, developing and installing new procedures or 
practices in educational inrsti'tut^ons. The strategy is based on three basic elements of identifying clear goals and 
objective^, assessmer^ ^nd analysis, a«d identificatior^ of additional' ways; Jo_ achieve the obj^tives, or 
alternative educatibnal practices. Each of the three elements is^iscu^ ^ ^ ^ . 

Guidelines forfhternaf PlamingandlEvaluatipn in the Flqrida Department of Education, TaWaha^e: Departrfi&nt 
ofEducation,Ktey.8, 1972.*^' ' ' \ ,\ ---^ 

The third* policy paper of the tniogyjsslied by t^e Oepartmpnt of Education discusses, E)epartroent-;interna1 
planning and evalua^iorr ppoces?§s 9nd ^nteria, t^o fcon_sider as' basic guidelfnes in -planning and pvaluating 
' pcograms' , * ' " f \ * ' ^ 



COST EFFECTIVENESS; COST ANALYSIS ' * . ■ 

Cost Analysi§ Management Information Systerh (CAMIS) Copyright 1972. Tallahassee; Department of 
Education ^ \ . - ^ 

E)^lains a new accounting. system for Flonda's public School districts called the Cost Analysis Management 
Information System (CAMIS) . Explains the need and developrnent of CAMIS and i& dimensions and provides 
guidance m the implementation of CAMIS. . , - o « 

A Manual . Financial and Program Cost Accounting and Reporting for Florjda Schools. Reprint # 1 , Tallahass^e- 
,departmer^t©f Education. March, 1975. ^ *, . 

« ' ^ ' ' # - * ' ^ , 

-Jhis manual is a revision of the Cost Analysis Management Information System (CAMIS) manual issued \a. 
Florida school districts jn 1972>The revisions followed a number of developments regarding tfife use of tfife 1972, 
manual which necessitated modifications to the system and a plan for uniform minimum implementation in all 

districts by 1975-76 . ' • ^ / ' 

- i . ^ > 

PEBfORMANCE OBJECTIVES, DEVELOPMENT OF 

Mealy, Johri and others Classifying Performance Objectives. Tallahassee: Department of Ed.acation; \ -'^ ' 

This report cjemonstrates how to coristr_uct and_cja$sify irerform^noe objectives. wilb examples The fjye primary 
categonzations are motor skills. verbahhforma^4on,mtell^ctuaTskilts^^^^^ " ' ^ ' 

SAMPUNG PROCEDURES ' • . . \ ^ 

Sampling Procedure Preliminary Test of Reading Related Skills, 1971-72 Tallahassee: Department of 
EducatK5n, no date ~ c ^ ^ 

Tht$'tsan explanation of the sannpltng procedures to follow in Selecting'Studer)ts fp take a prelinHj^afy test of*' 
seiecxed leading skUls. 197 1 -72, thiaexpianatiOn is4*f€cted to tlie sc^f)Qo\ f^^rKipaf, scliWooortiinator-. o< other 
destgnated.persopnel who are to choose the sample t)ne week prior to assessment. / ' * 
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Dr. Thbm^H Fisher, Coordinator of Disseminatidn 
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Public Act No. 30,7 , i$69 (§: 14 of fiscal bill) Lansing. Michigan State LggiSlatlre, Augusy2. t9B9.' ' 

tniiiated by the State Department of Education, this Act authorises tl^ Depart menf of Education-*to develop 
state assessment pr6gram that objectively measures pupil learning outcome,sin basic skills. 

' Public Act No 197(l{VoL'ia,Mich,C±.A.,S 388. y08 7036; .Lansing. Michigan StataL'e^isl^re. 1970. 

This Act IS a ipore comprehensive law mandating the state' assessment program, with' several accountability 
apprgaches ' / ' " ^ ' f . :^ 

EDUCATIONAL'GQALS ' , ~ . / 

Jtsi Common GoBts'ofMcfitgan Edutatton Lanstng: Department of Education, September J9T 1 . ' - 

- Jhis article- provides'jnforma^ion on the development of educational gaals for Michigan ancl presents ttie learner 
Voutcome^oOals as adopted by the State Board m 1 97 1 . Also mcJuded are four suggested prfegr^ms leading to the 
attamPne^t of the goals:_^ quality teaching, accountability, assessment »and evafu^^t^OA" and 'research acid 
development' ' * - * ' ~ \* ^ ; • ^ 

is ^ \ ^ . ' . , ^ . * 

ACCOUNTABILITY SYS^EiOiS; MODELS ^ / J ' , 

PosiPforr^Statemem on Edi^catidhal /^ceounfai}///fy.lansihg:,Deparm«nt ot Education, W2, • • 

Xhe statement pre'septs the.'rqle off the Statue* Board ot ^du(5aj[lon an^ Department of Education in< implementing 
"l-;:^ accountability Vnodel for MicKigart's ^ ' \ " ' ^ 
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Taking Michigan'$4Educati^Bef^ Lansing: Department of Education. 

This brochure explains the sfx steps that makeup Michigan's accoufitability model.,^ " \/ 

Porter. John W., AccountabilRy in Education, Ah Address. Lansing.-'DepartmisAt of Education. March, ,19'71. , 

Thts IS ae address^y Dr. John'-Porter, .Michigan's'State Superintendent C1 PubhcMnstructjon, regarding his 
understanding afJd ^elief$.,,about accouhtajDility a^^d^^.gfidie of the problems jny^ved' in esta&li^g-an^. 
accountability system. - ' 



The A^s^e$jmen( (}f'Bk^tatibmi'f^ mfMiph^an: Merno^m^difm.;,' Lansing* -Departmem orEducatibh, 
January 28yt969 . ' ^ • ^* ' 

This rt)^rv)p to the Michigan Stat^ BQ3rd.of Educatioh regards plans'for an assesOTent.'of educational progress 
for the st^te. It give^ the back^rouh'd of assessment in 'cither states ^nd irf the l;^.S..';.a p^ible rationale and 
procejdurjes for iper^odifi asse$smeni. ia;M}chiganr disciussidri of opposition .to thel assessment; and 
recommefhdatronsfof theMichrganSt8teB^)^fdofEdue9'tion; l':' ' ' " '. ^ ( - ' ' 

f^urpqsS^nd Procedures qf tff^ Mc^igar).As$essrr)j^rit 'orBtkJCam^^^^ Report Number On^. Lansing: ^ 

. Qepaftifrientof Ed^ucalion, Augiist, t969.ERICE^ . > 9 a ^ 

';/•".! • ' ' ' ' ' I./ ^ ' 

TIais repert outlines W:}(}6a\ schopl^Astnct personnel and otier interested headers the first of the assessment ; 

-aetivit^ei' that took pt^pe^urmg Ihe n9,69-70 school year. Theieporl cft^s the pjurpos^es of the assessment; gives 
. some infprmation pn;th?dssbpsimerit of basic sk|ils the first year; and presents a study of variables descriptive of 

pupil backgrounds and &0pQOi;^nd;$ql>c^^ system resource levels whidh ^^[^chtgan terms "correlates." 

Activities and Arr^n^'cMpt'^ for thfi mS-tP Ulictilgarj Aseessment of Educatidfi: Asse,s$meht Repvrt Numb'er 

fvvo Lansing: DepantftS^toif Education, Decernb^r J 969. . • : " ' ' 

' ' ; ^* 'I ^' ' '; •! • ■ ' • • 5 - ; ' .*•; ' • ' ' ' 

^ Report^Namber Tw6;pP0fridfesia Summafy jij)!' the prggifess in the absefe^nhent program for 1969*70 and dejails 

some of the acttj^l.m^^n^nic^^^ the progrj^p tHese details includo tftfe selection |)f focal dlstn<bt coordinator^; 
. the appointmeri! of a":^^njcal ad^5sofy grpup; naming a specif tcations^cbmrnttteeno- review test specifications;- 
' organising a citil^eos'^comnjiitjpe o^J goals; tKe^dfriinistratior^^of the teat ^ahery;|$LtiD|ect areas ^nd grade$ beipg * 

assessed; data an^lysi$;ar^>0PQfltrfgth^r;e^^ r ^ ' .j' ; ;■• *•: ^.j' : ' ■ " • . - \ ; 

Technical RepoH'^f^SelebteU^AspectB olthe fB69-70 Michigan £dacattona1 lAss^ssment Program, Lansing: • 
■ Department of Educat^on,,ij^ugust;197■^F^repa^edb^^ ; ' /.^ ' 




achievement batfery apd^the pupif background questionnaire; the.dpveJopmeilt of fhe'^sgaled scores arising from 
the statistical.treatment respdhses tp' th^ iteir^ trtthe battery; apd'Charactefifetic^o^ tfjs battery components. 

Levels of^ Educational: Perfbrm^nce and Refated'f^actorjs in Michigan: Ahsessmdnt Report Number 4. Lansir>g: ' 
Department of Educatiofif, 1^70. ERICeD 046 987; • ' • ' ' : " : 

The three sections m this;epdct presemMhejhighhgi^s jof^e reSiiHs.o explain 
precautions to tretaken in th&ihterp^elation of the datfl; describe the assegsnieVj^ n?easures used; apd present 
education profiles for fttfChigah's/egions and community ^typfes,.on^ for eadh^of the sta(te's;four^ographic- 
regions/ahdfofr the fourth and seventh grades. ' ^; *■ • ^ * 

Distribution^ of Educational P^rformatic^ and ^ei^te^ Factors in ' Michigan: ^Asses^ment Report Numbe/5. 
. Ladsif)g:DepVjm.^l of Education. 1^70. ER(CE - , ^ / 

* ' • y " ' . * \'' ■ ':: ' , , . . / 

/ ^ This repon. Of. tlje- l9fe9t7(rMit^higarf /^ssfesspnent PrQ^rar^i*' presents d$ta which indicate the, ways in which 

, 1 * ^A. «luo^ttona t performance and certain te^^ (varf^i^)",fe^^^ 

. first section summarizes the findirigs pre.sented iaihe report, jhe Sedond state^precaotfonsjo be.taken in Ihe 
- interpretation t>f the.'SltarThe thW pres^nt^aeftnitkjofi.ftf the a6s6ssnr>ent Measures usetj in the report. The 
/ ' .-fourth secticfn'expt^iris how. the educatiojn* distribuyon * tSbtes were prep^red^ Ind the fifth ^ntains the^ 
• educational difi^tnbIjtjon^ables&ndbrie(^sufTTmarie$ of .the . . . - 

Eduoation, 



/ 



LdcaJ, DistifCt Report: ^Explan&tory^^fe^s: Ai^sg^en} RedOrt No. 6. ^Lansing; Oepartmer\t of \ 
1^70. ERI&ED.045 733. ' " • ^ v^^t^^- • . • ^ - . - ^ v 
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■ ; ' the 4a{a jsresented in the local -district's computer printout. The third section defines the assessment measures, 
■ and the fourth describes the norm.tabtes^t>ia't are provided in (he boa)Wet." 

' Local District Report- Supplementary Explanatory Material Addendum to Educational Assessment Report No. 
6. Lansing. Department of Educatton, February, 1971 > . i ' 

This report prov4des locaFschooi officials with addttional interpretative a?iessment information from the '1969-70 
' prograrri written in nontechnicai language. Thftfirst sectwJfvpfQvides definltiorfe of certain statistical terms used in 
the assessment -effort. T+ie secorref'section outlines the constructiori and meaning of the 1969-70 assessmem 
scores' The fftifkl section discusses the construction and use of pupil norm tables which are provided in th6 
booklet. Af] appendix lists the socioeconomic and attitude cjuestions used In the assessment. , 

Distributmof Educational Performance and Related Factors in Michigan:' A Supplement: Assessment Report 
-Wo 8. Lansing' Department of Education, 1971.' ERIC ED 059 254. * ' * 

This report presents supplementary data that indicates ways in w,/iich educational performance and certain ^ 
__.---^aCTorslva7iaBIes)' related to performance are distributed in the state as determined by the results of the 1969- 

70 assessmentprograrh. Limits of the data and cautions to'be exercised in their interpretation are presented; the 

measures used in the assessment program are described; and the construction^ and interpretation of .the • 
• > -educational distnbution tables are explained. Brief written summaries of the fihdings of the major tables are 

included • ' , ^ ' . ^^r^ 

Levels o{Educational Performance and Related Factors'in Micfiigan: A Supplement, Assessment Report No. 9. 
Lansing: Department of Education, December, 1970. ' , . 

Supplementary matenal is presented in this re/ort regardfng data which shoyvs the iQvef oi educational 
performance and' the levels of certain factors (yjiriables) related to performance within Michigan s geographic , 
. • regions and community'types reported in an ea^er dqcumenf. It utilizes and desbnbes afl the perforrnance levels 
of all the>^torsgathered in the assessment: / . 

4epof[ contains education profiles .f«/ geographic regions and community lypes ot three varieties: (1) _ 
MuM^constructed from distriet-Jevel assessment results; (2) profiles constructed from school-level assess-. 
<fin\ results- and (3) profiles constructed from pupil resp6nses to the 1969-70 assessment battery. 
•Txamination of the profiles will enable the reader to understand the levels of educationaj perfprmance, as 
measured by basic skills achievement, and certain faetors or variables presumed to be' related to performance in 
(he state's geographic regions a^nd Community 'types. 1 ' - ' ' ■ " ' 

Obi.ectives and Procedures of the MKhigan E^tional Assessment Program^ 1970-7 1: Assessment Report No. 
7 Lansing; Department 0f Education; 1970. ERIC ED 049 299. 

Report.No.'f presents the 197.0-71 objectives and procedures for the second year of the fvtiqhigan Educational 
.Assessment Program, . . " * ■ 

19J0-7Uhdividual Pupil RepW: Explanatory Materials. Lansing: Department of-Educa(ion, April, 19tl. ERlCED 
053|17. -. ' . • ■ ' ■ ^ ' " 

The first teport-of ttie results from the 1970-71 assessment of grades 4 and 7 is irttended to provide school, 
distnctawith basic information regarding students that will help them, ttiefr parents, and educators fo assess . 
'their-pxogress The ftrst section describes the content of each test (vocabulary, reading; mechanics of wntten 
■English and matfiematics) . Cautfens to be used in interpreting the^data are expressed; and an explanation of^ 
how to irrterpret the materials accompanying the booklet is ^jpvided, as well as exptanations for pupils scores A 
final, section defines-statistical terms used in^he proQram Snd provides technical information regardmg the 
"assessment battery. ' > . - ' - ■ • " 

Local District and School Report: Explanatory Materials: The Third fleport of the 197J}-71 Michigan Educational 
Assessment Program. Lansing: Department of Education, Juie, 1S71. ERIC ED 059255. 

The purpose of this report of the 1970-71 assessmen^sto provide locaf school district officials with irffofmatiOn 
regardinalheir own schbol dstVic't arid its schools (d assist therrr in cmjgag local-decisions in the .allocation of 
- resources and the design of educaOonal programs. M ^Iso provides a fPie)'alJhdica(ion of the.qreas within the 
kScal school district which may need closer study: The firsCsection-deseribesprecagtidhS to.consider in using and ^ 



interpreting tjie data and defrnes statfsiical terms used. The next section ouUines the assessment measures and 
introduces the computer print-out^, containing the local district and school data. The third section describes the . 
, nQTtntabtespfovfded With the report, * ^ - • - - * - c 

Local Distm' Results, Michigan Educational Assessment Program: Jhe Kourth Report of the 1970-7r Series - 
Lapsing: Department of Education, December, 1971 ERIC ED 064 288. ,^ . * . ' , ' ' ' 

The purpose of this report \i to provide the public with information regarding the average scores on the 1970-7 1 • 
educational assessm.ent measures of a\\ pul;ilic school distnct$«in the state. It provides st general indicatfon of 
areas within the local school district which may need closer, study. Each of the distrfct^measures is presented in 
two ways: first, a figure ^s shown that represents the district's ^core on each measure; second, a percentile rank* 
IS shown for each measure that indicated how each district fared in relation to the other districts oh each of the ^ 
measure^. Decile distributions ^re included to show what percentage of the district's fourth and seventh grade 
, pup/lsrearneclcomposite achievement scoreain each decile of a statewide tabulation of pujjNI sf ofes. They show 
what percentage of each district's pupils fell into each of ten general achievement levels. 

Levels of Educational Performance and Related Factors: The Fifth Report of the 1970-71 Michigan Educational 
Assessment Program. Lansing- Department of Eflucatton, June. 1972. ^ . ' 

This report contains education profiles for Michigan's school distndts. schools, and pupil$-for the 1970-71 
ed^ational assessment. \Us designed to answer the questiQn of what is the level of b^sic skllls^achievement and 
of other educational as§pssment measures in Michigan and in lUichrgan's community types. Examined are the ' 
levels of basic skills performance at ^radps 4 and 7 tn CQmrmjnicatiOns skills and mat^neriafics ^nd the levels of ^ 
certain factors (variables) presumed to be related to performance, such as expenditures per pupil average; 
experience of teachers, etc. Community types are metropolitan core city, city, urban fringe, town, and rural, witfi 
the state being the basic frame of reference, Profiles a[e constructed from district-level mean scores on the 
^aa?essment measures, school-level mean spores, and individual pupil 'scores. ' ' , 

Distrit^ution of Educational Performance and Related* Factors: The Sixth Report of thf 1970-71 Michigan . 

Educational Assessment Program Lansing: Depar\rnenuo\E6uca\\on, June 1972 

y , ^ ^ ' ^ - ' ' ' 

This report ^Ohtams a series oT educational distribution profiled for the state as a whole, prepared from the 1970- 
71 assessment results, in order to determine- whether certain stud^t and school measures (such as school ' 

^ financial resources, staffing resources, etc.) beer a relationship to pupils' levels of ba^tc skills achievement in the ' 
state's schools. It determines theralationshtpof students' background charactenstics to their achievement lev*el, 

• to the levels at which their^chools are supported, and 40 teacher characteristics, ^ ' . 

Educational A^sesstnent -and District Enrollment in Michigan: The Seventh -Repdrt of the 1970-71 Michigan . 
Educational Assessment Program. Lansing* Department of Education, June, 1972. . - 

The report contains education-tables^or. groupsof Michigan school district^, divided On4he basis of-district size, 
, designed to answer the question o1 whether school districts with different ^rollment sizes score differently /as a 
group, on the Mrtjhigan-assessment variables. Forjhe 1970-71 assessment.. ~^e, as a basis for classifying 
districts, took the place of the geographic regions used in the 1969:70 assessment. • 

.'Technical Report:- The Ninth Report bf the 1970-71 Michigan Edupational Assessment Program. Ijansinq- 
Dep^rtmentof Education, June, 1972. ' ■ i. • 

The primary^unction ot this report topresfent the fechnicaf^^ to evaluat^'the'instruments dhd 

techniques usedMo roeasure and report the status^f student achievement and attifude'in the 1970-71 
assessfh^nt^rogram. The first sect^6n briQfty describes the 197t\71 asse^ertt prbgr^m. The second section 
. describes the assessment battery and- contains two subsections \hat ^eal with its noTicogmtive and cognitive * - 
parts. Each^ subsecliQn explains the instruWnts involved. thi6 derivation of reported scores, and the- 
psychometric properties of the measures. , , * * " ^ i < ^ 

Ob)eetives and Procedures: The F/rs/ Report of ihe^ W7i'72 Michigan Educational Assessment Program^ ^ 
Lapsing: Department Qf Education, Octokier, 19^^IC ED 059 257*' • * * 

The purpose^of this report Is topro'vide local sehool disWt officials yvith'mformation about Ufe 197 1-72%lich>gan 
^Educational Assessnoertt Program, Ita objectives, and the procedures (h^t wilt b#fo«QW€^d, Presents fhe six basic * 
elements of an analysis process adopted by the State Board as.t he^ccountabillty model for Michigan. ' ^ 



Kearney. C. Philip. The Michigan Educational Assessment Program Lansing: ^Oepartm^nt. of Education, 
November 1, 1971 . ' ' |, ' 

This IS an address given by Dr Kearney, Associate Superintendent of Public Instruction, before llhe U S Senate 
Select Committee, on E^ual Educational Opportunity, ^n which he descrfbed the Michigan Educafional 
•Assessment Program from the time it was f<rst conceived and implemented m 1969-70. through the operation of 
the jjtogram in 1970-7 1 . and the objectives and procedures of the 1 97 1 -72 year of the program. 

IndMdual Pupil Report, Explanatory Materials, The Second Report of the 1971-72' Michigan 'Education^^ 
Assessment Program Lansmg Department of Education, April, 1972. ^ '* 

The purpose,of this report is to provide local school officials with information Vegardmg the performance.on basic 
/skills achievement of each student who tooK the 1971-72 assessment battery, as well as with informatw that will 

* assist the officials m understanomg and interpreting their stfidents' scores. The con^nt of each test is described, 
cautions to te used m interpretation are, provided, how to interpret the materials is explained, and statistical^ 
terms used in the program are defined. m ^ 

Local District and School Report Explanatory Materials -The Third Repori of the 197 1-72 Michigan Educational 
Assessment Program Lansmg' Department of Education, May. -1972 ERIC ED 059 255. 

This report provides local school district officials with the 1971-72 assessment results of their own school district 
arid Its schools for the purpose of'assisttng therti in making local decisions about the allocation of resour^ and 
the destgn of educational programs. The report'gi^'es a general indication of the areas within the local district thai 
may need closer study It cont*ains precautions to be used fi interpreting the data, lists the assessment measures' 
and introduces the computer print-out^ontaining local district and school data; describes ]he norrh tables m the 
report, and explains how to construct and interpret distnct-ievel and school-level education profiles. 

Local District Res^jlts' The Fourth Report of the -1971-72 Michigan Educational Assessmeni Program. Lansing, 
pepartment of Education, September. 1972. ^ ^ 

This report provides the public with information regarding the average scores on the educational ass^ssrrient 
measures of aH puWtc school dtstftcts^m Mtfchtgan mvo^ved^ the 1 97 1-72 a^essmeot progranr^. Ar-eas Within 4he 
localdistnct which may need closer study are indicated » * ^ ' , - 

Technical Report' The Fifth Report of the' 1971-72 Michigan Educationa'f Assessment Program Lansmg- 
Departrrient of Education. November. 1^72. 

This report provides technical information needSd to evaluate the instruments and techniques used in the T97 1- 
72 assessment program. The report describes how the basic , skills instrum^ts were developed -(word 
relatiooships. reading. nr>echanics of written English, and mathematics) and how they were reported, as well as 
, the composite est4mate of socioecof>omiC status, ' . • /» ♦ 

The Equating Report: Year-To-Year Analysis of the Cognitive Tests of the Michigan Educational Assessment 
Program. 72 Lansing- Department of Educati(jn^March.i973.' 

• • 
The purpose of this'rfeport is to provide infoVmation and data with which state and-local educators can analyze 

• the achievement data dUhe assessment program on a^year-to^year basis and on a state, tocal<*strict, or schbol 
basis. A discu^of^ of ihe need for equating test scores^nd 9 the general procedures by which equating is done 
I? presented in the first section. The second sectipn discusses in detail the equatirTg^of the assessment 
achieverneot !ests from 1970 through 1972. The final section presents thecautionsrand limitations inherent in the 
equating processes. ^ - y ' ' 

Objectives and Procedures: The First Report of the 1972-73 Michigan Educational Assessment Program, 
Lansing: Department of Education, October. 1972. . 

This report restates the obji^ives ot the Michigari Educational Assessment Program for me 1972-73 schpol 
year; projects the future^longrfangr plans for the irtformation and planning of fo^ldtstnctd^^and state otfl<:ials; 
and indicates m sorw detail the specific prpcedures to be foHowed tn the 1972-7p prbgram. 



Individual Pupo Report Explanatory Materials The Second' Report" of the 1972-73 ^ichigan Educational 
Assessment Program Lansing. Department of Edife al T Or rN^rch, 1973. ' • . - * 

This reooft provides local schooloffjcials With information regarding the performance ontasic skiHs achjevernent 
of eacf) student who took the 1&72-73 Michigan Educational Assessment baliery and gives information that wiH 
assist the offrcials m understanding and -interpreting their students' scores The first section describes the 
content of each test (word relgtioriships.^ading, mechanics of written English, and mathematics) . The^ond 
section presents cautions to be used m the interpretation of individual pgpil scores from the program The third 
section descrrbes the materials th^t accompany the report and explains:pupil s cores th at they contain. The final 
sect:on defines siatisticaf terms u^dth the prograrri.and provides technical information abouLthe assessment ' 
battery . . ^ ' , - . i> • . . • 



Local Distnct & School Report Exf^anaVpry Materials- The Third Report of the 1972-73 Michigan Educational 
Assessment Prograrrk Lansing- Department of Eduction, March. 1973 

Tne report provides local distric/officials with' ir>formatiop to enable tfiem to understand an^xjtihze the local 
district an*d local schooLrapor^i provided by the Michigan Educational As^ssment ^Program for the testing 
.period of January. t973 Tt>e f^port is accompanied by the data sheets and norm tables sent to each dtstr^t and 
IS intended to facilitate theiyjse By following procedures given m the report, local school district officials c^n 
construct education profil^4hat will enable them to relate assessment results for.. their distnct and schoolsic 
results ootained by groi^ps^Gf other distncts and schools throughout the- state and in the same community 
Officials can identify levels' of educational performance rn selected basic sktlls and levels of selected non- 
achievement (jieasures ff*! their school^ and district 

Jechrifcaf Report The F^fth Report of the 19/2-73 Michigan Educational Assessment Program Lansing 
Departmentof Education March. 1974. . • , 

The report provdes the technical information needed to evaluate the mstrurnents and techniques used in the* 
1972-73 assessment program It (§ intended pnmaniy for.directors of research, research c&nsultartts. and school 
' counselors 

' Assessment Admirustratipr) Mani^l.^M^htgmEduc Grade 4. Year 5. 

Lansing Department of Education 

* * 2 

New objective-referenced tests vi^e used for the 1973-/4 Michigan Educational Assessment* Program, and this 
manual bescnbes the procedures tf' be used loa??nijiin,ie> llaOgsi^tog'^acje 4 pupils 

Assessment Admirifstration Manual. Michigan Educational Assessment ProgrS[rrh>4973-74/ Grade 7. Year 5. 
Lansing' Department of Education • . -v,^^^^^^^^^* 

This manual descnbes the procedures to be used to administer tests to grade 7 pupils for the 19^74'MK:higan 
Education^^^A&sessment Program. It involves%new objective-referenced tests requiring different procedures for 
admin isffation.' - * . 

* ' » - 

^ Local ^nd Intermediate District Coordinator s Manual' The 1973- 74 Michigan Educational Assessment Program. 
Lansing. Department of Education? . - * • 

This manual instructs the local and intermediate district coordinators in the 'procedures necessary for 
adrtiinistenng the 1 973-74 assessment to grades 4 and 7 pupils in thfi subject areas of reading and mathematics. 

School Coordfria tor's Manual:* 1973-74 Michigan Educational Assessment Program, Lansing: Department of 
Education ^ I 

This, manual instructs the school coordinators ip 'the procedures necessary" for administenng the assessment 
instrument to grades 4 and 7 pupisin thesubjecT areas^ek^ingand mathematics in i973-74. 



Instructions for Agmmistering the Pupif Attitude Questionnaire- Michigan Educational Assessment Program, 
1973-74 Lansing Department of Education. 

JhfS report contains instructions fofadministering the pupil attitude questionnaire used-ln the 1973-74" Michigan - 
Educational Assessment Progran^. The school districts participate. on a voluntary basis under orie of three 
options -fnvotvesall fourth and seventh graders, involves only all fourth graders, involvesonlyall seventh graders 

Michigan's New ^^l^acher Aid' Brochure Lansing Department of Education ^ ^ 

This IS a small brochure which summarizes the changes in the new state assessment tests to be administered in , 
the 1973-74 schoohyear The te$t%now are objective-referenced instead of norm-referenced, and performar)e# 
wtiit)ecortipared to objectives. Detailed information will be presented for individual students Grades4 end-7' will 
b^^ested tn reabing and mathematics 

'^'Objectives and Procedures. 1973-74 Michigan Educational , Assessment Program, First Report Lansing: 
Department of Education. August. 1973 . ^ ^ ' • 

•This report xontams the objectives and procedural aspects tb be followed during the' 1973-74 assessment 
program m which objective-referenced testing was intro.duced. for the first time It described how the 
performance objectives. and objective-ri^ferenced tests were developed Appendixes contain nnathematics and 
reading objectives to be measured m the 1 973-74 program tor grades 4 and 7 - 

Individual Student and Qa^room R^orts Explanatory Materrals, 1973-74, Michigan Educational Assessment 
Program. SecondReport Lansing, Ddpartmeot of Education, 1974 

This guide -was prepared to help edulatcjprs interpret 1he information provided for individual students and foe 
classroom>groups that resulted from Miwigan's Ecucational Assessment' Program condUCTfSdin 1973-74 in the 
subject areas of mathematics, reading, a\)d word njtationships Objective-referented instruments were used for 
the mathematics and reading tests; a nomn-refepehced measure for word relationships. Grades 4 and 7 were 
tested The tests are described, and aids in interpreting the information' contained in the reports are^provided. 
The objectives for the mathematics and reading tesis are presented in the Appendix. - 

School and District Peports Explanatory Materials 1973-74, Michigan Educational Assessment Program, Third 
^eporf Lansing Department of Education, 1974 . - . 

^ '•*-^.*'' ' 

'This IS an explanatory report to assist m the interprfetation ot local and school district sumnr>ary reports provided 
by the 1973-74 a^essn^ent program Educational assessment measures used in the 1973-74 program are 
described, anc^'the Appendix contains a listing of the mathematics and reading performance objectives for 
grades 4 and 7 - \ ^ • ^ ' 

State Summary r>f ResultSr 1973-74r Michigan ^ucatiOnal Asse^ment Program, Fourth Report, l^ansing: 
Departn^nt of Eojcation, 1974. , ^ 

This^summary presents a compilation of^ the scores of the, State's fourth and seventh grade students who 
participated in the 1973-74 assessment program, the first year objective-referenced test items were used irf 
Michigan' ^ , ^ . . • ^ ' . ^ 

Ot3i$ftives and Procedures, 1974-75: The First Report of the 1974-75 Michigan Educational Assessment 
Pribram, Lansing* Department of Education, August. 1974, 

The objectives and.procedural aspects of the 1974-75 core assessment program are described in the first report 
of the 1974-75 senes.^as'weil'as the first grade pilot assessnjenrmtroduced at this time and new test items 
developed for selected science and mathematics objectives which wiM be tested m a sampieV^f fourth and 
seventh grade students Lists of perfofhianceobjectivesin reading, mathemattcs. and science for grades4 at\6 7 
andthepr^primaryobjectivesaregivtenirithe Appendix. , ^ J ' 

,State Summary of Results. 1974-75. Michigan Educational A^^^ssment Program, Fourth Report, lansing: 
Department of Education, March; I97j5. SJ • ; - ' 7- 

The report presents a'compilation of the scores of the fourth and seventy §f^de students who pa.rticipated in the 
objective-referenced assessment program during 1974-7&. The reporf deiir>eates the purpose of theassessment 
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program, makes some comparisons with 1973-74 data, and discusses the possible meaning and significance-of 
the results 

*. * , , ^ 

Grade 4 AssessmenfAdrnmiStration Manuah Michigan Questional Assessment Program, 1974-75. Uinsing: 
Department of Education. 1974 

Thfs manual describes for the lest 9<fmtnisUator the preparations necessary pnorto testing and the procedures 
for a0mimstration of the assessrrienl instrurnentsto grade 4 in the 1974-75 program ^ 

Grade 7 Assessment Administration Manual- Michigan Educational Assessment Program, 1974-75, Lansing: 
Department of Education. 1974, 

This rVianual describes for the.test administrator the preparations necessarvBrior to testing and the procedures 
for administration of the assessment instTum^ents to grade 7 in the 1 974-75 rfo|ram. 

School Coord^'ator's Manual Michigan^Educationaf Assessment Program, /974-75 Lansing Department of 
Education. 1974 " . * • ' * 

ThiS manual outlines for the school coordinator of the assessment progrin the procedures necessary for 
. administer. ng the assessment instruments in the coordinator's school. It also csQtainsyrlformatlon to assist the 
coordinator in arranging optinnal testing condUrons for the students. 

LocaJ and Intermediate District Coordinator's Manual' Miohigag Educational Assessment Program/ 11 974-75, 
Lansing Department of Education. 1974 , ' t 

^ ' ■ ' ! ' 

*This manuaf outlines for the district coordinators th§procedures rjecessary for administering the assessii?nt 
rnstryments m theic districts and assists them in arrangiRg optimal testing conditions for their^ students* / ' 

Michigan's Educational Assessment Program: grades ta^e Assessed. Lansing: Departm^t of Education 
January. 1974 ' ^ » * • \ ' 

ThFs^^port olaifified the Siate-Board of Education's policy dOd thinking 'regarding the grad^'or levels to be 
included m present and future educational assessment plans A tentative timetable for implementina the 
assessment of grades V. 4. 7. JO. and 12 )S incltided, beginning with 1973-74 and earned through the 1977-78 
school years " , ' i \ ' 

f ^ ' * i 

The LongJRange Plan of the Michigan Educational AssessmentWcgram, Final Draft. Lansing: Department of 
EduCatior^>4.d?»4^ • , ' ' 

This IS a final draft of Michigan's lohg-range plan for the educational assessment program that was presented to 
the State Board of Education for approval. It projects a general, outline of development for the r>ext five to ten 
years and \s meant to be a flexible plan subject to revision., if. necessary Chapter \ contains background 
information about the program and it^ relationaj;iip to tWe^six-step Michigan Accountat)ility model. Chapter II 
states the purpose and eight go^lsof theijln^higin state assessment program. Chapter III describes the (earniffg 
areas to be assessed, the grad^ levels aind students Xo\>e included in the program, and the time schedule for 
implementing the vanous com^onent^f the program." %he core assessment and sampling components of the 
program are explained. Chapter IVpresents.procedures }pr the development and/of revision of the performance 
objectives and test items." Chapter V discusses dala collection and analysis. The^sixth'chapter covers reporting 
and dissemination procedures. ' ' ' > ^/ ' * • 

Assessment Coordinator's Feedback Survey. Lansing: Department of Education, Fel^ruary, 1974. ' 

This reporttontains the results of a survey of the local school district assessnnent coordinators conducted by the 
Mtphigan assessment staff to gather ipformation about the success of the Michigan assessment procedures. The 
survey took place following the first year of objective-referenced testing in 1973-74 Iby Michigan. Previously, 
norm-referenced testing was conducted. Results of the survioy were to be used irl designing the 1974-75 
program •The overall response tathe survey was favorable. The most often-mehtioned informatiqnal need was in 
the area of interpretation of the results, and the nr>ost senous difficulty encountered was in the area of scheduling 
tests and njakerups. * 'V 
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Educational Assessment, the Michigan Plan, Lansing: Department of Education, February. 1975. 

This document describes the 1974-75 educational assessn[)ent in concise. e€^-to-und^stand terffis aad 
explains exactly whatl^ind of Information is generated from the ass^sment for ^ local and state educattonai^. - 
decision makers Future plans for expanding the assessment program^lso are discussed. ^ . * , 

Objectives and Protedures, 1975'76- The First Report of the 1975-76 Michigan Educational /^sse^m^ 
■ Program. Lansing DaDartnr>ent of Education, July. 1 975. \ ^ 

This report presents the objectives of the assessment program 'anirtnJl^cates in detail some ofihe^sp^rftc- 
procedures to be u§ed m the current year. 1975-76. In additfpn to the co^^assessrrlent^of grades 4 and 7 in 
reading and mathematics, experimentalltems were tried out in grades 4 and /Sn the sukiject areas of realSing, 
Vnathematics. aPd health. The first gr«de pilot assessment wa^.contmued in t975y.6, ^nd a limited pilot project 
.was introduced for grade 10 m reading and mathematics, the experimental items and the first grade pilot 
assessed all the students m the specified grades in a sample of schools. The tests fkoba tenth g(ade assessment 
were administered to a group of volunteer high schools .* , \ i 

PERFORMANCE OBJEdTIVES. DEVELOPMENT OF ^ 

Deve/op/ngPe/l^ormanceOi?yec//v'esXansing- Department of Educkion, ^ • > 

One of the six steps in Michigan's accountability model is the development of performance objectives. This 
booklet describes the six-step accountability model and how performance objectives fit into the model; defines 
What performance objectives are and the difference between goals and performance objectives; and explains, 
with concrete examples, how to develop the objectives. 

r 

The Developmental Process for Performance Objectives In Reading and Mathematics. Lansing: De^partment of 
Education, no date. ^ / 
^ — / 
This article is a two-page surhmary of the process followed by Michigan from 4he fall of 1971 to 1973 for 
developing performance objectives in reading and mathematics. / ~ . - 

DEVELOPMENT OF TEST INSTRUMENTS 

' Development o( Test Items and Instruments in Reading ajnd Mathematics for the . 1973-74 Michigan^^ducaiional 
Assessment^ Program. Staff working draft of test development. Lansing: Department' of Education- January, 
1974 

This report de^nbes the process of developing the objective-referenced tests used in the 1973-74 Michigan 
Educational Assessment Program. It explains the overall procedures followed m developing performance 
pfefectives in reading arid maftiematics; the selection, training, and supervision of test item wnters; the validation 
of the test Items, and the selection of the objectives-iind the test items for the 1973-74 program. 

A Report on the Technical Characteristics ofthe Reading and Mathematics Instruments of the 1973-74 Michigan 
Educational Assessment Program, Submrtlpd to the Michigan Department of Education by Research Triangle 
Institute. Lading: Department of Education, April 12, 1974. ' ' 

Research Triangle Institute assessed the techriical quality and adequacy of the reading and mathematics 
assessment instruments^ised in ttie 1973-74 asisessment program at jhe level of the individual performance 
'objective. The 1973-74 assessment 'program is .described briefly. The reliability and content validity of the 
instruments qre examined, analysis of the significance of test- length and passing score is provided, and 
information useful for the interpretation of results r§ included. 

DISiSEMINATION METHODS 

The Michigan Assessment of Education, 1969-70:. The Politics s>f Fteporting Results. Lansing: Department of 
Editeation. February, 1971. ERIC ED 048 366. 

This article is a detailed and candid account pt the difficulties th^, Michigan -Department of Education 
encountered following the first assessment program in 1969-70 because of gubernatorial and legislative 
pressures to report fndividualpupfl results. ^ " 

- - , , . , St . . , 

toi 
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B^tinghaus. Erwin P and otK^. Keeping the Pubhc Informed Accent on Accountability Denver Cooperative 
Accountability.Prbject. 1973 ERIC ED 095 214 

^Ttiis IS a digSs^^ofa more detailed report which develops a dissemination model for educational accountability 
, programs/lt wSs prepared for the Cooperative Accountability Project by the State of Michigan, one of the seven 
^i.^,ate members of CAP. The; digest explains the four basic steps to be taken to accomplish an effective 
- accountability cpmmunication program and includes tips for \vdrking with the news media. Several observations 
^out the comrpunicatioh process and.three basic theonesabout communication$are discussed 

Beningnaus. trwTn T and 'G'^ ft. MilIer7M'ichtgan~STate University Pari /, Reactions to, State Accountability 
^fPrograms A Drssemmation System for State Accountability Programs Denver Cooperative AccountaWitv 
Project. JuneJ 973 ^f^lC ED .111 841 » • • 

The first of a three-part report, prepared by the State of Michigan for the Cooperative Accountability Prbject, 
offers a dissemination model for educational accountability programs. The model outlines potential strategies for 
the appropnate reporting of^ the results obtained frorn the application of several educational accountability 
models This part of the report examines current and past accountability models along with the reactions of 
vanous publics to those models 

Bettinghaus. Erwin P. ^d a R, Miller. Michigan State University Part II, The Relationship of Contemporai^ 
. Communication Theory td^^ccountability Dissemination Procedures A Dissemination Systei^- /or State 
Accountability Programs CS^ver. Cooperative Accountability Project, June, 1973. ERIC ED 1 1 1 842 

The second part of a threo^art report, prepared by th(§ Stfcte o^ Michigan for the Cooperative Accountability 
Project, offers a dissemmtion model for education/ accVintability programs. This part examines current 
dissemination policies wiTh^n the framework of conterrtDoraryVnamunication theory to develop a rationale for 
the construction of an appropriate dissemination mo,del 

Bettinghaus, Erwin P. and G R. Miller, Michigan State Unive?^Hr^arr ///, Developing Dissemination Procedures 
for State Accountability programs, Denver: Cooperative Accountability Project, June, 1973 ERIC ED 1 1 1 843. 

The third part of the thi'ee-part report, prepared byjhe State of Michigan for the Cooperative Accountability 
Project, offers a dissemination model for educational accountability programs. Part 111 outlines a dissemination ' 
progranjand specifies its relationship to educational accountability. 

'Bettinghaus, Erwin P., Michigan State University: Final Report, Preliminary y^e^-SMjy: Dissemination of 
Educational Accountability. Denver: Cooperative AcpOuntabtlity Pro}ect^^J3?4r^mC EDWI 840. 

This report describes a limited test of the potential dissemination model prepared by. Michigan for the 

Cooperative Accountability Project which took place from January 1, 1974, to March 30. 1974. The aim of the 
.test was to investigate the reactions of participants at the local level in an attempt to tram them to disseminate 
^-element§ of ttie model. Included is an evaluation of the project, the project's accomplishments, a budget analysis 

of the project, and recommendations for future efforts tn this area. Materials produced for the project are in the 

Appendix. , ^ ' 

ADDITIONAL REFERENCES 

Where Research, ^Valuation and Assessment Fit In. Lansing: Department of Education, April, 1973, 

This report d^cri^es the goals and major activities of the Research.^Evaluation and Assessment Service of the 
Michigan Department of Education and its relatior)ship to Michigan's six-point educational accountability 
process. , , \ ^ , 

i • 

A Survey oi Views Concerning Michigan 's Fourth Grade Assessment Program, 1973-74. East Lansing: Michigan 
Education Association, 1974. , 

The Michigan Education Association surveyed a sample of fourth grade teaCh4^/$^1974 in Michigan school 
. districts tqobtainth^ir views, participation m, and use of the 1973-74 fourth gr^^al^^tnent ^ ^ 
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Report and' Recommendations of the MEA Tast Force on Assessment and Accountability. East Lansing: 
Michjg^p Education Association. March J'97^j^ ' 

This report presents the Michigan Education Association's position on accountability. assessment;behavioral 
objectives, and compensatory education m the stale and is generally critical of the Department of Education s 
assessment program.^ 

Hou$e, Ernest. Wendell Rivers.'and Daniel Stufflebaum An Assessment of the Michigan Accountabihty System. 
East Lansing Michigan Education As_socjation. March. 1974 

Thisreport examines the.Michigan Accounjabiltty System with particular emphasis on the assessment program 
Reservations and disagreement are expressed -about the minimal objectives, the validity of the tests^ the 
'put>(ishing of a book of performance objectives, the desirability of every-pupil-testing.^nd the tying of funds to ^ 
gams in test scores Nine recommendations are included 

A Staff f^6sponse to the Report An Assessment of the Michigan Accountability System East Lansing- Michigan - 
Educatior^Association, May. 1974 ^ • 

•The Michigan Department of EducStton responded to the House. Rivers, and Stufflebaum report. An 
Assessment 'of (he Michigan Accountability System, and the nine recommendations of the panel, three of which 
the Department dftSiicaijon staff did not accept The staff resjionse addresses each of the issues raised by the 
panel and attempts to correct errors in the panel's report, point out differences in philosophy betweeri the 
Department of Education and the panel, and to indicate areas of basic agreement with the panel's suggestions. 

Murp(iy. Jerome T and David K Cohen "Accountability tn Education— The Michigan Experience " The Public 
/nreresMNumber 36, Summer. 1974 

This discussion is about accountability and assessment as practiced by Michigan which was written because of 
the state's extensive experience m this area. The report is a critical one and provides some indications of the way 
accountability wd^'n the authors' views and some suggestions about the relation between scientific and 
.political control in eoK^pn. , 

Survey on Educational Accountability for the Michigan State Department of Ecjucatipry Detroit- Market Opinidn 
Research. May, 1974. . , „ ' . , 

This report descnbes how Michigan residents and the state's public school teachers perceive the concept of 
edu6ational accountability, who, in the public's view, should have the responsibility for making Michigan s public 
schools accountable to the citizens, and whether the citizens feel their schools are accountable to them. 
Recommendations are included for lonprovement in the understanding of accountability and the six-step 
accountability model of Michigan. A concluding part of the report is entitled The Observations and Conclusions 
of the Superintendent of Publig Instruction These observations and conclusions were reached by Superintend- 
ent John W Porter and sent to the State Board of Educatioa and they were based upon his review and study of 
the survey The four conclusions contain 16 recommendations for the purpose of clearing up the ambiguity and 
vagueness that surrounds the meaning of the term, "educational accountability," alleviating the concern and 
opposition directed toward accountability systems; assisting the local districts m implementing th6 six-step 
accountability process, and providing teachers and administrators with the skills necessary to develop and 
implement. accountability-based strategies. ■ - 

Womer, Frank B. Developing a Large Scale Assessment Program. Denver- «^ative Accountability Project, 
1973. ERIC ED 084 641. 

Tftis report is a product of the Cooperative Accountability Project from the State of Minnesota, one of the CAP 
member states It contains a wealth of practical information concerning the establishment of an assessment 
program at the state and local district levels and about assessment as an aspect of accountability. It suggests 
specific action steps that should be taken to determine what and how much the students are learning, alortgwith 
tlie procedures to be followed to bring about improvements. Assessment is clearly defined and how to go ^out 
the many planning tasks in assessment is delineated: determining the administrative structure, types of 
assessment outcomes, types of test instruments, reporting categories and reporting policies, pqpulation to be 
tested- whether sampling ^s ,to be used; data collection methodology; data analysis strategy; costs and 
alternatives; and time schedules. Other clearly described subjects are the deyeioprrient of assessment 
objectives: the use of existing instruments; the dev^foRitient of new instruments; selection of a sample; collection 

- . - - 
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of data, processing of results; utilization of results; and d(sseminationactivities. Also included are checkpoints for 
evaluating a quality assessmerrt program and the outlines of ftve state assessment programs in operation in 
Minnesota, Texas. Pennsylvania, Florida, and Michigan. ... 
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Colorack) 

TITLE 22, ARTICLE?, COLORADO RAISED STATUTES, 1971 
'^^S-if-t, .Short title. This article shal) known and niay be cited as the "Educational Accountability Aq\ of 

lle3M1*2. Legislative^leclaration . , ( 1^ f he general assembly hereby declares that the purpose of this articil 4 . 
•to institute an accountability program' to define and measure qualijy in education, and thus to help the pulJlic 
schools of Colorado to achieve such quality and to expand the life opportunities and options of the stli.dents of" 
thfs statp, further, to provide to local school boards assistance m helpirig their school patrons to determinef the 
relative value of their school program as compared to its cost. • 

' (2) (a) The general assembly further declares that the educational accountability fDfogram deyeloped under 
1his,articleshould be designed to measure objectively the adequacy and efficiency of the educafionaisprograms 
offered t^r the public schools. The prograrri should begin by developrng broad goals and specific performance- 
for the educational proces^s and by identlfyingrthe activ/ities of schools i/vhich Advance students 
these goal3 and objectives. The program should then develop a means for ^valuatMlsHhe^achievements 
performance of students,- It is the belief of the -general assembly that tn developing thp evaluation 
echanism, the following approaches, as a minimum, should be e^cplored:' ' . * 



(b) Means for determining' whether decisions affectiipg the educational process are advancing or impeding 
student achievement, 

^ (c) Appropriate testing pffocedures to provide relevant comparative data aPte^t in tjne fields of reading, 
language skills and mathematical skills; 

(d) The role of the department of education in assisting school districts, to strengthen their educational 
programs; 



(e) Reporting to students, parents, b^^ards of education, educators, and the >^nei 
educational performance of the public schools and providing data for the appraisal of such ^ 



:>ublic on the 



perforr 



(f) Provision of information which could help school districts to increase 1heir eff^iency i/ using available 
financial resources. . ' 

123-41-3. St^t? board tot education — duties, ^(1) (a) The state board of ^i^Jup^ion shall devefof)-^ state 
accountability program, v^hichy' , ! • 

■ (b) Descrijbes and provides for implementation of ja proceduc^ for the continuous examination and 
improvement of the goals for education in this state. ^ » 

(C) Identifies performance objectives which will lead directly to the achievement of the stated goals. 

(d) Adopts a procedure 'for determining the extent to- whicYi local scho9l districts accomplish their 
Performance objectives. Evaluation ifistruments/ir>cluC)ing appropriate testsv shall be developed under the 
aVi{hprity>of this article to provide the evaluation require^, but standardized tests shall not be the sole means 
developed to provide such evaluation. ' * , ' ; - - ' ^ 

\ (e) Recommepds a procedure and timetable for the establishment of local accountability programs.' 



\2) The state board of education shafi adopt rules and regulations for th6 implefnentation of (his article. ' . 



(9) (a)- There is hereby created an advisory committee to the state board of educatioo, which shall cohsist of 
seventeen members to be selected in the manner and for the terras provide in this subsection (3) . The advisory 
conc}mittee shall assist the stat^ board of education in performing its duties under this article. 
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I (b) (i) Three the members of the advisory committee shall be appointed by the speaker of the hou^ of ^ 
[representatives, of which no more than twx) sTiall be from each of the major political B3rties>and tWo;<5f the 

members of the advisory committee shall be appointed by thfe president of the senate, one from eaeri of the 

rriajor political parties. . ' / . ^ " ^ - * 

(n) Five members of the ativisory committee fehall be appointed by the governor from amon^those persons^ 
Vhoarecurrently serving or hav^e-serve^d as rnernbers of boards of educatro '/^ " " r^" ^r^^-y^- 



which 



(ill) Seven members of the'adyisbPy comqnittee shall be appointed by the state bdard of 0jju 
ich shall be classroom teachers and three of which shall be public schoDI Administrators. >f 



Cation',, Three of 



(4) The terms of office of'membersT of the advisory committee shall be three years; except that of the 
members appointed uitider subsection (3) (b)ti) to take office on July 1, 1971, two members shall be 
appointed for one-year ierms, two members shall be ^ppolnted for two-year terms, and one member shall be 
appointed fptr^a three-year term^^lliejiiembers appointed u t3) (b) (ii) to take office on July 1, 
1 971 , twd'frfembers sbialibe'apponted for One-year terms, on^ member shafi be appointed for a two-year term, 
and two nnembets shall be appointed for three-year terms;;and o{ the member^ appointed under subsection 
(3) (b) (ill) to take office on July 1, '1971, two members shall be appointed. for a one-year term.Jwp members 
shafl be appointed for two-year terms, and three members shall be appointed for th«ee-year terms. Vacancies 
shall be filled by appointment, in the same manner as original appointments, for the unexpired term. , 

(5) The advisory committee shall elect a chairman from among its membefe The members of the advisory 
committee shall receive nq compensation for their services on the committee but shall be reimbursed for their 
actual and hecessary expenses incurred in the performance of their duties ori the committee. 

' (6) The department of.education Shall make available to the advisory committee such data, facilities, and 
personnel as are necessarylor it to perform its duties. 



123-41-4. Local accountability programs: (1) The board pf education of eac^jschool districUn the state shall 
adopt a plan for a local accountability program designed tomeasure theadequaS^aiTileff^^ pf educational 
programs offered by the,distlrict. The board shall appdint/^n advisory accountabilrty commTftee vyjiich shall make 
recommendations'to the board relative to the program of^|pountability buf it shall b^the responsibility of the 
board to implennent the provisions of this section. The'advisory accountability comnyitee shall consist of at least 
one parent, one teacher, one school administrator, and a taxpayer from the district. 

(2) Th^ board of educatton of each distnbt shall report not lajer than Deof^nber 31 of each year to the 
residents of the district, and to the state board of education, on the extent to wWich the district has achieved its ' 
stated goals and objectives. The report shall also contain an evaluation of educJational decisionsinade dUring the 
previous year which have affected school^ervices and processes, 

(3) The state board of education shall assist Jocal^oards of education in the preparation of the district goals 
and objectives and the procedures for measuring schod district perTtormance iin reaching' those gt)als §nd 
^objectives. ' n. - « / v ' . * * 

' 1?3-41i5/Reports. N®t la^er than Mafch 1, 19^2, arjd^ach year thereafifer, the state board of education shall 
transmit -to the general a^embly a report of its activities in developing ^nd administenng the educSti^nal 
accountability program, includingihe progress of the state and local school dis|ricts toward the achievement of 
their respective goats and objectives; T^e state t^oard of education shall also recommend any^egislation Which it 
deems necessary for the improvement pf educational quality in this state. 

*^ • ' • - * ' ^ 

Section 2. Eftectivedate. This act ^hall take effect JuJy^ I,* 1971. ' " 
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Sootten^S. Appropriation; In addition to any other appropriatior^, there is-hefeby 'apprQpriate(j out of any 
mpneys in the state treasury not otherwise appropriated, for the fiscal year begiinning July l/j971, (6 the 
department education, tlie sum of forty thousand dollars ($40,000) , br so much thereof as may be ne9essary 
for^theadnyastrationandirrip^ementationoflliisact ' \ / > 



Section 4. Safety clau3e.yTh^ general assembly l>ereby finds, determines, and declares that tl^is actjs-hefcessary 
^v^.'. ^or the imnmii^atepr^secvatjohof thepi^licpeac'e;health. ^ - ^ ' ^ 



TltLE 22,ARTICLE 44,P^ART2, COL 0ft>lD0ftEWSEb5r>^R;rES, 1973 * , ' . 

^f^' .AN ACT AMENDING THE-*TROGRAM PLANNING, BUDGETING, ANID EVALUATING SYSTEM '(RPBES) 

* ''-ACTf" ' ' ^ • • ' ' ^ ' ' ^ ' 

\ Be ifenacWd by the Gerferal Assembly Qftfiie State of Cdlorado: ' • 

* if ' . - • - * * * 

SECT10M 1,. Article 42 *f cha^t^r 125, CoWrado Revj^ed Statutes *1-963 (1971 Supp is repealecf and 
reenacted, With amentJfTients, to read. . . . • ^ 

V ■ 

123-42-1. Shor„(^tle.This arttcf§.shatl be known and may bevCite€l as the "Financial Poliaes apd Procedures 

4^ Act." ;f , ' ' 

' ( 7 » ' m *' ^ 

I , 

123-42-2. Legislative declaration, tijs the purpose of this article 'to develop for the public schopisa program- 
onented budget format which will relate anticipated costs and actual costs t6 designated programs^- 



123-42-3. Adoption and compatibility of handbook. ( 1 ) The state board of education shall have the authority 
to adopt a financial policies and procedures handbook that will meet the n^ds of the existing statuteaand of 
^such other rule^nd regulations as may be necessary to fulfill the intent of this'article. ^r". , : 

(2) The financial policies ^ndprocedures handbook so adopted shall be'coryipatible wjth theprovisior^s^ the 
*'Accountabihty Acf'of 1^71/* but.shall be limited primarily to tfSe relating of budgeted and actual costs to 
designated progra'm^ , \y ^ 

123-42-4. Establishment of syst^ by school districts. (1). The state beard of education shallVepare a first V 

draft of the financial poKcies arid procedures handbook and shalJ send at least-one copy thereoHo each school - 

district in the state no l9% than Septembe; 1, 1973. 

* '» " • ' • » 

(2) The st^te board, of education' shall designate not less than fivd volunteer school districts which are 
repre§|^ptative to pupil size arW population to cooperate in finalizing a financtal4)otictes and procedures 
handb6(^urinathe1974budget^ear. . * ... 

.<3) Th^ slate board of educat^on'shanpfepare^l^nal draft of the financial policies and procedures handbpok 
ahd shall ^d at least orle copy thereof k) each schofisWistrict in the state no later'tRam July* 1975*. The 
financial policies and procedures handbookViafi be fully irh^emented on January f 1976 by all schtol districts 
having a school population ofloverone-liuhdfea'students. - . . 
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123-42-5. ReportyBeginQing on or before February 15, 1976, ^nd continuing tJb or before each February 15 
X ^^nd /August 15 thereatler, the secretary otthe^boardpf education of each school difstrict shall file with the state 
^ b©a^cJ ot education a seli^nual report of receipts and expenditures^of each fun^With designated* fxogram 
reports^naccordance with the stale board's adppte'd financial pd 

^ / ■ • • ■ 98'-- , ^ : * , 
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^ .123-42-6. Administration. This article shall be adrntntstered by the state board of education The state>Q|rd of 
* education shall have the authority, to adopt reasonable rules and regulations for the admyiistration^f ihts ariifcte^ 

' ' — • _ ^ ■ » ■• - 

S^K>n 2. Safetyx:iau^. The general assennbly tjereby finds, deternr^ines, and declaresMttgnfils acl'js necessary 
' for the immediate preservation of the public peace, health, and safety. 
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RULES 

' EDUCAHONAL ACCOUNTABILITY ACT OF 1971 
(Approved by the Attorney General of Colorado 4n September, 1975) 



2207-R-1 0 Definitions * . 

J 01 Charge: A statement' of purpose" from local boards to local accountability cdmmitfees The 
statement^should cover the ar,aes a board desjres the committee to accorrjplish for the purpose of 
• - providing asSfStanc^ and support to the distnct'sa^xountability program. 

* t.02 Cost: The amount of money and resources used tn the accomphshrftent of a program as structi^red 
and defined by the local district. ^ ' ^ 



1.03 District': A Colorado school district organize^^^^xf9*igT5u^^ to the law but n0\ im 
junior college distrtcf. • « -r-^" ^ « , * * ^ ' 

. J.04^ Educational Accountabjlity; Impractical and logical p'-oce^s for fookjngfl education and its benefit 
to students'in an objecnve fnaftner The process asks the districts "to establisK educational goals. 
. deterfjiine objectives, desrgn and implenr>en^ a plan that will work toward tfS^^attainmeAt of the • 

objectives, design artd implement a procedure for evaluating accomphsfiments of the programs, 
^ and. use the information-commg.from {he evaluation la plann^r^g. budgetwig, ari'd decisfon-making. 
^ The process includes reporting the accomplishments and costs of programs to th^ public ■ 

< / ' ' T-.r-'-r.--' ---^' 

1.05 Educational AccoantabHity Programs: The plan for process ^fined in tJU which defines. 

measures, ^nd evaluates quality ih education. The dest^ pf'the* prbgr^;m $hOTd prpv^de for the^ 
fdehtificati§n. gathering, analysis, reporting, and use of information ifi the^^lari^ing. boiSgeting, ancf 
. ^ decisiorhmaking activities of a dfsfftct:' ^ ^ ^ ' * ' * * ^» 

, i .06 Evaluation: /Tcontinu ous procedure for appraising'lhp accomplishments of objeQtives. 



1.07 Qoafe: Gfenferal and t»meless\iatements (J^rtbmg what a cfi^thc! desires 10 pfOV^d^;!^^ : , 

Goals state th^^road purposeaft^ direction abound which a dtstnct desigr«^ucafiofiat;pSro9^^ 

1.D8 • Lbcal Board: The local board of education le^ a dchooi a^^^ ^ - ^ • ^ 

1 .09 . Major EcUicattonal Oedision: A course of action determined by the local board that has a significant^ 
*Trni)act on ex^Stingprogr^nns, initiates new programs, or affectssc*«oofsefv»ces and processes? 

X/ • ; 

.110 * Program: A set of tr^related procedures and activities desSgfhed by the <listricts to achieve thar 

. stated goals and objectives over a penodQf time. The parts of a prograrni^^^^ . 
V , ^ to insrtructronal and^ppprt activittes. melhocb of ir^SlhKt^rs^^^^^^ ^ ^ 

" use ofcurncuium, policy, and.other variables as m^jj^ ^ * " . ' 

1 11 • Reoort Jha dewtoiiQn tbe.tccaT bg^ra to theleitizens surwroriziftg the «cofr9)fi*fnw^ aha 

• • * • " c&tTofnt^ distfiof^ ^<MKBfi6nai pr(ygf^m:iB^^ rntjor educalior»J jieosions oft 

" student learrwig* The nsport should toe in a tormtt and vocabulary understandable by lay citizens. . ^ 

— - 7 -- 99 - - '^v-:--- - -^-''^--'r :: 
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1 12 Resources: An av^^Jable source of supply, support, or assistance. Resources may be perfennel. 
finances, facilities/equipment or materials ^ * 

' ' A ' - . ' 

1 13 Staff Objectives: Statements describing m measurable or observable terms what the school district 
personnel will accompli^ to support ^^\^ teammjg outcomes given m the student, outcome 
- objectives. The objectives define thexjuahty in management, organizatton and planning a staff 
. shof^provj.de for learning programs. They are flexible and can be changed or modified^ 
• " * 
State Boartf: The Colorado Board of Education composed of elefcted representative from the 
Congressional Districts within Cdpr^do^^^^^^^^^^^^^ ' ^ , * 

' . 1 15 Student Oufcome Objectives: Statements describing a learning outcome in measurable or 
^ r V observable terms that will be worked toward by th6 student. The objectives define the quality in 

' ^ ' learning from the educational programs. They are flexible and can be changed or modified 

• 2 01 EducationalA^DWrtafetB^Pr^ The local board of each district shall develop and adopt an 
educational accountabilitypiogMwibas^ student and educational needs for that district. ^ 

/. ... , ^ : ' ^ • « 

''-?:02 Educati<»iat P|an^ The district's plan for its educational accountabihty. program shal^ be reviewed. 

u|5-dated, and any revisieos i« fhe pfan adoptedJ?y the local board on or Wore July 15 of each year.- 



~ "2 ^3 ^ Resources for Plan: In applying accpuntability to budgetary process, the local board shaH develop 
* . J^e capdt^lityahdtheresponsibility to account for the expenditure of money and the com^^ 
• , \, resources in terms of the results adh^eyed bj^ educational accountaMity program. This 

— ... • '*<'>vo»vesboth4f)estewafdship*of-nfto^ 

fetation to specified objectives and goals. The format should be in accordance with the pinanci^k * 

' ^ V * PplfCies and Procedures Handbook as prescribed by the Financial Policre? and Procedures Aot 

• . . : , . ' . . * . • • 

::• - . . r: .2 04 Evaluation of Plan: The local board of each district shall design, adopt, and carry on an evaluation ' 
* * procedure that is consistent with the accountatTility process, .The evaluation procedure should be * 

^ used to assist the district in identifying the strengths and weaknesses of its educational program^, its 
objectives; andits goatelThe infomr>ation and facts gathered through th^ procedure should be used . 
tofofcnu^te^^>propriateeduGationaldeci^^ ^ * / . , ^ 

2^ Report to^fate Board: Oaor before June 15 of each year the local bodrd shall reporttQ the State ^ ' > 
Board on Its educatkxialaccountabifity^^ogram for the previous ai^ " • 

. ^ .submit an.applicafion to the State Board requesting a thirty to 

; , date. Tf^ report shall mcSude the extent to which- the .disWcttias-acliieHJ its stated goiais and- 

^jectives and an analysts of educational decisions nriade during the previdifis^schoor year whk^h 
have affectedschoot programs.-servkjes, and processes. The reporting form will be providerfby the ^ ^ 
Cotorado Department of Educatiort. ' . : ^ 

-J 2.°6 to atfcwnr On <x before Decemljer 31 <rfea<* 

■ - . crfe9B§. The report *allifHAjKtetiw extert^owhkrfi the ^ - 

objectwes. the cost of pirograms;^a»'an%sis of educate T~' . ■ 

. --..^ «*<»l yew 'whk* haw affected 9chooJpipgran«.servk*^ .J 

reports the optkjn of theJoo|^d»tr^rt ana niayirKkJdebui8»M*fKrt be «^ * ' . 

described in 2.06 of these rufe. " . * . * ' 

' ' ' " • ( 

220741.3.0 Local AccountabStty AdvWory ComnWttee,^ ^ * ' V 



3.01. Appolntm^rtandReppooalblWr The lo«tf Wd, upon the adV^ 

. appoint members to the local; acdountaWtty advisory committee. MerflbersNp of the local 
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committee shall be reported to'the Stale Board through the annual accountability report. The 
.committeeshaflserveasan'adyisory body to the local board. ^ ' • . 

' J* _ - * 

3 02 Membership: The 'local committee shall consist of at least one parent, one' property taxpaymg 
resident Wbd does not have children in the district's sctiools, one teacher, one administrator, and 

• one student - from the distrjct. The local superintendent, or such person as^ he shall designate. Shall 
serve as a resource 'member of th^ committee The State Board recommends that the local boarjj 
include representative ethnic and economic groups of persons of both sexes in the composition of 

. t . thtecommitfee ♦ ^ 

3 03 Size and Distribution: The size of *the local committee shall be determined by the local board. The 
distnbution pf the total number withiri the.committee shall proyide a batance in numbers among the 
, groups represented ob the committee. ^ 

3 04 ' ^ Terms: The length of term of the members of .the local committee shall be established by the local 
V board, * , ' 

' 3 05 Internal Organization: The local committee shall elect a chairman from among Js members and 

• shall establish a schedule of meetings and general rulds for it& operation This Worrjiajion shall t)e 
filed with the local board All meetings of the committee shad be publicized mrougb the media, 
where feasible, at least tyventy-four hours in advance and shafl be op§t^tothepublic..\ - ^ 

3 06 ' Charge from Board: The iecafboard shall establish'for the committee a charge consistent with the 
purposes ot the ec/ucational accountabihty law "a(^send a statennent of the charge 1o the 
committee The charge should be revised and u{fcdai|jPom tifne to time by the local board 

^07 ■ Planning: Tft^fixal committee should establish objectives and a plan for itself. lhat will work toward 
theaccomplishrhent dnhe charge tromthe locat bcSard- ■ 

3 08 • Reporting to Bo^rd: The commtttee should report to their local board at lea^t twice durihg the 
school year on its objeptives arid plan for accomplishing the charge frorp the board. 

3 09 District Educational Plane The local committee shall recommend to the local board on or before 

^ July f5' of each year an educational plan for the continuing.development oj the accountability 
* process in the district. Local boards may request a thirty-day extension-of the plan date. 

2207-R-4.0 Local AccoiintabifftyPrograiTtt . . 

4 01 Authoi^tion: The board of Jbucation of kch school distnft. through'its superintendent, shall 

cause ;to be designed, adoptVd. implemented, and maintained its educational accountability' 
program as defiried in 1.05 of -the&e rules* - ^ . » * ■ ■ 

' 4*02 Review and Revision: The review and'revisibn.lDVtt^e local board of the district's pian for its 
educational accountability program shall tal<e place^ually but no later than June 15 of each year. 
. * - < - - ^ • 

^ 4.03/ Parts of: T^e developrDent ot an educational accountability program shall consist of the following 
- five sequential phases: 

4.03'( 1) To develop, analyze.redefine. and improve a statenrient of goate 

. 4.03 (2) To Identify and prepare staternenf s df student outcome oiljectives apd staff objectives f 6r 
the district. - — * • ' ' 

' . . 4.03 (3) To improve, 'modify, w dereto^ progr a1ns to achieve th^ student outoome objectives arid 
staff objeictwes ??fih©^nct. _ * * ^ — 
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4 03 (4) To detefji^if!ejia^^^ report the strengths, weaknesses, accomplishments, and 
costs ojJtiefSfablished programs in terms of thegpate, student oUtcQme-objectives, ^ind 
)jectivesofthed($tnct. ' * ^ ^ . ^. _ 

4.03 (5) To redefine and modify, based on evidence from ttoe evaluation procedure, any of theparls 
' ' or char^ctewstics of a program through planning, budgeting, and decision-making. 

Timetable: The 'local board shall establish a timetable for the development and operation of its 
e(5tJcational accountability program as described in 4.03 of these rules 

Roles of Partidpants: rn designing and implementing the district's educational accountability 
::^ogram. the board. it§ superintendent, and its local committee shall work through the distnct's 
p'-ofessional staff of administrators and .teachers, other citizen advisory groups that may be 
established by the board, and the community. The functions and responsibilities of participarits in 
js ng planning and accountability for improving instruction should include but not be lirT>ited to ttie 
'O'iQwing procedures and activities. - 

^ 05 n ) The administrative portion of the professional staff shall assist and support the superintend- 
ent in t^e ifTiplem^ntation of the decisions and procedures />eeded to facilitate the 
^ educatiorr^ programs, shall provide ^stance and support to the teacher portion of the 
' professional staff as it works with the educational programs; shall provide information and 

recommendations describing the outcomes of the educational programs to the local 
committee and the local board for. use in the planning., budgeting, and decisioh-making 
. needed 10 design or improve the educational programs. • : 

4 05 f2; The teacher portion of the professional staff shall assist ^nd support theadTninistrative staff 
m the implementation of the educational programs; shall work closely with the administra- 
' itve staffm the ptanHmg-of educational progranfs and Jhe Tbfrfiulation of objectfves Tor the " 
.programs; sha|J serve as facilitators for the educational programs ^n their, areas of 
responsibilities; shall provide information and recommendations about the strengths and 
weaknesses" of programs they work- with to appropriate groups for the revisiort and 
.n^oclification of the prWams; shall proVidejnformwion iand recommendations about the 
strengths and weaknesses' of programs to the local c*rjfpjttee and the local board-for use in 
the pjanning,^budget«/g. arid decision-making needeiljc design or iriiprove tflfe educational . 
programs.* i - * * I • - f 

4.05 (3) Channels (or communication should^be e?&tabfished letween theWal committee and olher 
board appointed citizen advisory groups wher» theylre dealing wi!%$imilar or related areas 
of educatioAal concern. * *^ ^ ' - 

/ - \ ^ ' / \ 

4 05 (4> The*communjty. of the district shpuld b^cou'ra§€p to express their coteerns and desires 
about the district's educa^jonaf programs through communication wrth tt% local board, the 
superintendent, or the locarWnmittee. * \^ - 

5 0 Cdonado Board of Education * "\ ^ . " \ ^ 

State Accountability Program: The State Bbard sJiall?eCownend procedures for thi<leve 

of a state accountability program which shall: ^^^"^--^ ' 

' " ' ' * ^' • ^--^ 

5.0 1 ( 1 ) Describe ari^ pro\>ide for the imptemerytatton of a procedure for tt>e contmE 

and improvement of a set of goals for'education in trie State of Colorado 
i • . • • * 

5.01 (2)Cause to be designed an(Jimplernented proceAir^ that would assist In idemflying those 
factors or conditipns that may influence the attSWit of quality m educatk>fv'ff^ the State 
^ of Colorado v/*" , x i J^ I 

;t procedures for , evaluation withm the aocbur^aMtty process that^l and 
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support the local districts in determining the extent to which student outcome ob/ecttves 
and staff objectives have been accomplished. Evaluation instruments, including appropr/- 
ate tests, may be developed to assist, districts m data collection which can be- used in 
planning^budgeting, and decision-making by the local district. The use of these instruments 
shall be at the option of the local districts.'Standardized tests 3hall not be the sole means 
developed to assist the local district in collecting needed information, 

5 02 Support to the State Committee: The State Board shall provide such data, facilities, personnel, 
and such budgetary assistance as are necessary for the State Accountability Advisory Committee 
to perform Its duties. 

5 03 Support for Di^tricte: The State Board shall establish policy and procedures that will assist'focal 

boards in'the preparation of district goals and objectives and in-the design and implementation of an 
evaluation procedure for measuring the degree of accomplishment of the distnct's^educational 
program in terms of the goals and objectives 

5,04 ' Report to General Assembly: The State Board shall transmit to the -general assembly no falter than 
March 1 of e&ch year a report of its activities in developing and administewng the educational 
accountability program, including the progress of»local school districts toward the achievement of 
* their respective goals and objectives The State Board shall also recommend any legislation which it 
deems necessary for the impi^Ovement of educational quality in this state 

2207-R-6^.0 Colorado Department of Education 

6 01. Assistance to^Loa^l Districts: The Colorado Depactmen^f Education shall provide assistance and, 

^support to the local distncts in the development, revisiSi. mcjfJification, and maintenance of 
*e<iicat*onalaccountabilityprografns. - ^. - . - ~ - . - - 

6.02 Collection of Available Resources: The Colorado Department of Education should serve -as -a 
resource center for the local districts in the development and use of accountability through finding, 
collecting, designing, and distnbuting publications, procedures, and other resources asked for by 
the local distncts. Inforniation should be ideflfified and made available from the districts, the 
departmen!^other professional groups, other states, or any other source that might assist the local 
districts 

* » 

• 6.03 Planning: The Colorado Department of Educatron shall use the information reported to the State 
Board by the locaN districts in their annual accountability reports to establish priorities and.plans for 
giving assistance and support to the local districts In their accountability efforts/ 

* * - c * ' ' ^ 

, 6.04 Coordination of TkccountabMity Process:«The Colorado Department of Education shall coordinate 
' and consolidate within 4he Bbucatjonal' Accountability Law of 1974 4-equests for the use of the 
accountability process that may be includedin educational legislation or recommendations from the 
State Board. All such accountability processes 'should^be referred \o the State Accountability 
^ Advfsory C<>mmittee for review and comment. 

2207-R-7,0 State Abcountabiftty Advisory Committee ' . / 

^ . ' ■ ^ . , . 

7.0 1 ' Respor)Sit>Hlty to State Board and Colorado Department ot Education: The State Accountability 
. \. Advisory 'Committee shall assist 4he State Board and the Colorado Department df Education in 

* A. perfonning their dultes as oivecwn jhe Accountability Law. The committee shalfbe an advisory body 
Xo the State Board antfth^^orado Department of Education. 

7.02 MerM>6r^p andterm: The membership and terms of office for the State Committee are provided 
*^ for m the^Accountability Law. ^ . 

7.03 Planning: The State Committee shall design arkl adopt objectives and a plan for its activities by at 

103 t * 



COLORADO (continuecf) ' 

» • • * • 

^ . least Jfu\y 1 of each year in order to fulfill its, obligations to'assist the State Beard and thQ.Colorado 

» ' Department of Education in the performance of their duties under the Law. 

7 04 Communication: The State Committee shall communicate and work closety v^^h the staff of the 
I Colorado Department of Education in carrying out its objectives and plan. 

' 7.05 , Alternative Approaches for Local Districts: The'State Committee and the Colorado Department of 
- Education sliould work to develop alternative approaches that local distncts coukJ adopt or adapt 
/ for the development and use of the accountability process. This should be a particular pnontyjn the 
evaluation and cost benefit analysis portions of the accountability process. 

7 06 Local Districts and Committees: The State Committee may serve in an advisory capacity to local 
distncts or committees when requested to do so. 
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Connecticut 

TITLE 10, S. tO-4 CONN. GEN STAT, T971 (Public Act No. 665) 

.AN ACT CONCERNING DUTIES OF THE BOARD OF EDUCATION TO EVALUAT€ THE/EDUCATIONAL 
PROGRAMS OF SCHOOL DISTRICTS WITH THE ADVICE OF- A LEGISLATIVE COMMITTEE 

Be It enacted by the Senate and House of Representatives in General Assembly convenea 



Section 1. Section 10-4 of the 1969 supplerpent to the gener^sjdtutes is repeal' 
substituted in lieu thereof: (a) Said board shall have general sup^siori and control of 
of the state, which interests shall include pre-school, elemen^yanfi secondary edui 
vocational education and adult education, shall provide le^rs^ipand otheryvise pr 
education in the state, including research, planning an0 svaklation; shal^epare 
publish such curriculum guides including recommend^tfions fpr textboahiTmaterial: 
determines are necessary to assist school distri^to carry out'^lW duties pre 
workshops and related activities; including progpmis of intergroup relations trainii 



and the foHowing is 
educational interests 
tion, special education, 
ote the improvement of 
courses of study and 
olher teaching aids as it 
ribed by law; shall conduct 
to assist teachers in making 



iuch 
nd( 



effective use of such curriculum materials anrfjn improving their proficiency in Sheeting the diverse needs,and 
interests of pupils; and shall keep informe^ to the condition, progress and nee/s of the schools in the state. 

(b) Said board shall submit to t^ governor, as provided in section 4-6Q|f and to the general assembly, a 
detailed statement of the activitie^ the board and an account of the conqlit^n of the publrc>schools and of the 
amount and quality of mstructipn therein and such other inJo'rmation as will Assess the true condition, progress 
and needs of public educatipr*. S^fd board shall develop^ cause to be devefoped an evaluation and assessment 
procedure designed to measure objectively the ade(Wcy and efficiency of /he educational programs offered by 
the public schools and shall report on these pro0dures to the joint starfjing^ committee on education of the 
general assembly by February 15, 1972. 

(c) Said board shall also include recomfKendations for policies and pnbgrams designed to improve edufcation 
and may publish such reports and inj£frmation concerning the ^ducitional interests of the state within its 
lurjsdiclion as it deems advisable. 

Section 2. This act shall take effect July 1, 1971 
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Florida 

y / TITLE 1 FLORfBA STA TUTES ANNQ^TA TED, S. 23o!?3, 1970 

Section 9. ( 1 ) Development of Education Evaluation Procedures. 

The commissioner of education shall, n© later than March '1, 1971, develop or cause to be developed 
evaluation procedures designed to assess objectively the educational programs offered by the public sfchools of 
this state. The evaluation procedures to be developed shall include such methods as are necessary to assess the 
progress of students at vanous grade levels and in the various educational proor^ms of the pgbli'c schools. The 
evaluation procedures shall be so constructed and developed as to providi^^ch school distnct with relevant 
comparative date to enable district school board members, administr^rs and the public to more readily 
appraise educational progress and to effect^te the strengthening of th^ district's educational program. The 
evaluation procedure shall provide a uniform, evaluation of each scTnjePAstnct in this state, and, to the extent 
possible, be compatible with national procedures for the assessment of progress in education. 

(2) Reports. 

The commissioner of education shall make a preliminary report to the state board of education and the 
chairrhen of the house and senate education committees by October 1, 1970. The preliminary report shall 
include the commissioner's proposed budget for implementing the evaluation procedures in the fiscal year 1971-1 
72. This proposed budget shall be included in the . legislative budget of the department of education. The 
commissioner shaH make a final report to the state board of ^udfttion and the legislature by March 1 , 1 97 1 . The 
final report shall include the commissioner's recommendations for the dissemination of the data on educational 
progress m each school drstnct.... 

Section 12. This act shall take effect July 1, 1970. - \ > 4 

TITLE 15, FLORIDA STAT UTE&ANNOtATED/s. 229.57, 1974 
- (Educational Accountablttty Act of 1971 ) 

A bill to be entitled: , j 

An act r^ating to education; amending subsections 229.57 (3) and ?29.57^(4) , Florida Statutes, 1971, to 
provide procedures to assure comparability between state -assessment and national assessment; to limit^ 
application of educationaf accountability program to the subject areas of reaailnc i, writing, and mathematics until" 
implementation.bf this act has been completed m those specific subject area^; \o provide that all students Will be 
tested in the third through sixth grade by 1975-76; providing art effective date/ 

Be It Enacted by the legislature of the State of Floric^a: 

Section 1. Sub^^ctior^^ (4) of section 229.57, Florida Statutes, 197 f, are amended to read: 
229.57 Educational accountability. — 

(3) Educational Accountability Program.-^— The commissioner of education is directed to implement a 
program of educational accotintability for the operation and management of the public schools, which shall 
include the following: // / " ' * 

(a) Pursuant to subse^ion 229.053 (2) (e) thfe commissioner, with the approval of the state 1>6arcl of 
education, shall, no later/than November 1, 1972 and eacf» y^r thereafter, establish major Oltrnate, basic, 
sp e c i fic, u n iform s t a tew id e s du catiorfal objectives for ^ch grade Iev0, and subject area, incltidihg", but not 
limited to, reading, wrijrfng, and raathematics, in the pyblid shcools. ^ 

(b) 'The commi^ioner shall develop and administer a uniform, statewide system "of assessment based in part 
oh critenon-refenefnced tests and in p^rt on norm-referenced tests to (Jetermine periodically^pil status, pupil 
progr^, and fne degree of achievement of^'^tabffSbecL.eA^D^^ objectives! Such System shaH include 
procedures fpf assuring comparabilfty where appropriate beSfeen^tudent perfonnance information collected 
and reportea by this system and national indicators of student performance. 
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(c) The commissioner shall make an'annual public reporlof the aforementioned assessment results. Sucti 
report shall include, but not be limited to, a report of the assessment results by grade and Subject area for each 
school district and the state, with an anarysis-and recommendations concerning the costs and differential 
effectiveness of instructional prbgrams. ^ 

• (d) The school board of each district shall by the 1973-74 school year make an anriual public report of the 
aforementioned assessment results which shall include pupil assessment by grade and subject area for each 
school in the district. A copy of the district's public report shall be filed with the commissioner 'of education. 

(e) The commissioner, with approval of the state board of education, shall by the 1973-74 school year, 
develop accreditation standards based upon the attainment of the established educational objectives. * 

( 4 ) Implementation.— This section shail apply to the subject area of reading by the 197 1-72 school year anb 
the subject areas of wnting and mathematics by the 1972-73 school year. No other subject-area shall be testeCL 
until assessment in the subject areas of reading, writing, and mathematics has been implemented. Such\ 
implementation shall include the testing of all third and sixth graders in the state by the 1974-75 school year and/ 
of all third through sixth grade students by the 1§75-76 school year in the basic areas ofreading, writing anp 
mathematics. An interpretation of such test in each school shall be reported in the 'annual report of school 
progress. \ 

Section 2. This get shall take effect upon becoming law. 
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Michigan 



PUBljie^ACT NO. 307 (S. 14 of 1969 Fiscal. Act) 
(Enacted in August, 1969) 



r 



Sec. 14. The department of education shal[ begin to plan and develop a state program for the purpose of 
conducting a periodic and comprehensive assessment of educational progress.' Such plan shall include ' 
procedures for the objective measuremexU of instructional outcomes among the elementary and secondary 
school students pursuing the various subjects and courses that commonly comprise school cur/icula. Such plan 
shall be made statewide in application among the elementary and secondary schools. Such plan shall include 
procedures" for the presentation of periodic evaluation reports Qf educational progress for the state. 

Also the department of education shall provide for an annual test or tests of pupil achievemerils in. the basic 
skills. Such test or tests shall provide for the objective measurement of pupil learning outcomes in reading, 
mathematics, language arts and/or other generarsubject areas. Such test or tests shall be undertaken at one or 
more grade levels among elementary and/or secondary school and shall be made statewide in application 
insofar as is necessary and possible. 

PUBLIC ACT NO. 38 (Vol. 18, Mich, C.L.yS, 388/1081-1086) 
< Enacted in 1970)f 

AN ACT TO PROVIDE FOR ASSESSMENT AND REMEDIAL ASSISTANCE PROGRAMS OF STUDENTS IN 
READJNp, MATHEMATICS, AND VOCATIONAL EDUCATION. 

The people offhe State of Michigan enact: : 

Sec. 1. A statewide program of assessment of educational progress and remedial assistance in the basic skills * 
of students in reading, mathematics, language arts and/or other general subject areas is established-in the"; 
department of education which program shall: 

^" ' ^ ' 1 

^oals in the- basic skills for students, and identif 
the greates! educational need in these skills. 



^5l5.t^^*'^''5^ meaningful achievement goals in the" basic skills for students, and identify those students wj^^ 



(b) Provide the state with the information needed to allocate state funds and professional services in a 
manner best calculated to equalize educattbnal opportunities for student^ to achieve comt^etence irLsuch basic 

N 

(c) Provide school systems with strong inceWw^ to introdjfce educationaUpfograms to improve the- 
education of students in such basic skills and modA)rog?SHaasto^ of achievement of students. 




_ / ■ * 

(d) Develop a system for educational self-iene\Jkl that would continuously evaluate the programs'and by this 
means help each school to discover and introfeuc^^rogram changes that are most lif^ety to improve the quality of 
education. 

s ■* • 
• '(e) Provide the public periodically with information concerning the progress of the state system of education. 
Such programs.shafi extend curcent department of education efforts to conduct periodic and comprehensive 
assessment of educationaf progress. 

Sec. 2. (1) The statewide assessment program of educational progress shall cover all students annually at ^ 
two grade levels in public schools. - . > ■ ' ^ * . 

(2) The department of e(jucation, hereinafter referred to as.the department, shall develop and conduQt the 
program, and may utilize Ihe assistance of appropriate testing organizations and/or testing specialist.' The 
programrshall expand the current basic skills inventory in grades 4 and 7 coordinated by the department. ' ^ 

; (3) The program shall as$e^ competencies In the basic skills and collect and utilize other relevant 
information esse^ntial to the assesSTTient program. 

• (4) Based on informatiorl from the program, students shall be identified who have extraordinary need for 
assistance to improve their competence in the basic skills. . • . \ 

' ; . ^ 1 „ , ip8_ _ . „ _ J_i 
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(5) Information from the program shall be given to each'sch9bf as s(3on as possible to assistitimts efforts to 
improve the'achievement of students in the basic skills. ^ , . , 

*Sec'. 3. ( 1) Based on information from the mathematics, reading and language arts assessment program, the 
department shall provide remedial assistance programs^^as funds are rrlade available by lavy to school districts to 
raise competencies in basic skills of students identified pursuant to subsection ^4) of section 2, A funded 
program shall include but not be'lffnitedlo the following component^: 

(a) Diagnosis of each student's performance difficuJties'a^nd the development of an instructional prpgram 
best suited to his individual needs. 

V 

(b) Provision for selection, adaption and installation of instructional systems that take account of individual 
student needs. 

(c) Provision for an evaluation of the program in order to i^jentify changes needed to improve program 
effectiveness. _ ' • , ^ 

(2) The department shall establish guidelines and specifications for the program components. The 
department shall provide technical assistance to each school district in its implementationof the guidleines and 
specifications. The departmenUhall conduct such evaluation neqessary to provide adequate information for the 

setting of guidelines. • . 

^ ** . ^ 

0 (3) The department shall provide for preservlce and in-servlce training of staff who would be involved in the 
school programs. ; ' 

,(4) The department with the cooperation of sheeted schools shall establish demonstration projects in basic 
skills. ' — . 

(5) A remedial assistance program shall be audited as pa^fof its-ey^ifeation by an agenCy independent of the 
" state department of education to facilitatethe accountablM of each school for its programs. 

Sec. 4. A vocational education demonstration^rog^m is established in the department of education to 
develop, test and evaluate the following innovative programs* 

(a) .A vocational education asse^ssment and counsehrig system using computer and other automated 
techniques. m - *^ > \ , 

(b) A new career development program to devise curncula and materialstefr new career-s in the labor market. 

Sec. 5. (1) The vocational education demonstration program 
3 school districts. The department shall formulate plans ^-"^ 
instrumenlj^ tor measurement of the progrann^^^DglJi©ftsTrati^ progr^ 
during the 197 1-72 school year. 

(2) The Separtment shall evaluate "the program and r.ecommend'to the governorajW theAegisfeture a 
, statewi.de vocational education assessment, counseling and evaluation program by DeQ^ffibef^3lJ^ 

SecPe The d^rtment ^all promulgate rules necessary to carry out the^ro^skiZ^^his act, in accordance 
with'and subject to the provisions of Act No. 306 ofthe Public Acts bf 1969, being sections 24.201 to 24.313 of 
the.Compiled Laws of 1 949. 



develoge^jtt:>^-teSfed in not mpre than 
iefect th€flJ§nTonstration districts^f^ develo 
ims shall be operated lO^iOTO^I districts 



This act is ordered to take immediate effect. . 
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1 Annotated Bibtiography of the State Educational Accountability Repository, Phyllis 
Hawthorne. Revjsed February 1 976. Wisconsin. 

Legislation by the ' States: Accountability and Assessment in Education. Phy4lis 
Hawthorne. Revised December 1975. Wisconsin. • 

4 State Goals for Elementary and Secpnjdary Education. Susan Ketchum Ribble. Revised 
September 1973. WtsGonsiR ERIC ED083747. 

5 Characteristics of and Proposed Models for State Accountability Legislation. Phyllis 
Hawthorne and Archie A. Buchmiller. Apnl 1973. Wisconsin ERIC ED 0785 14 

6 Accountability. A Bibliography, Gordon P. Hanson. July 1973. Wisconsin. ERIC ED 
084630. . , . ' ' ' 

8 Educational Accountability in Four States- (Colorado, Connecticut, Florida and 
• /Michigan) : Phyllis Hawthorne. December 1975, Wisconsin 

© Keeping the Public Informed: Accent on Accountability. A digest of the Michigan 
dissemination model. Erwin P. Bettinghaus and Gerald R. Miller. 1973 Michigan. 

21 Developing a Large Scale Assessment Program. Frank B. Womer. July 1973, 
Minnesota^: 

'Jopmg a -Large Scale. /Assessment Program,^ frank Womer, July 1973. 
MinnesoT 




23 Indicators and Statewide Assessment, Marc 



24 Rples of the Participants in Educational Accountabifity.^Carl E. Wilsey and Glenn B.^ 
Schroeder. 1974. Colorado. . . . , * • 

25 Using Educational Indicators for Program Acjoountability. MichaeLJ. Grady, Jr. 
September 1974., Cobrado. ' ■ ' , \ 

26 Costs of Educational Accountability: A Maryland Exploratory SiWdy. Novemtjer 1974^ 

Maryland. ' ^ ' 

. " • »^ » - ' ■ 

27 Condition Variables in Relation to Measured Student 'PetfQm)artce: The of 
Indicators in Pennsylvania. November 1975. Pennsylvania. ^ / 

28 Operating an Objective-Referenced Testing Program: Florida's Approach Yo large- 
Scate Assessment. 1975. Florida. 

I NOTE Documents wfth ERIC reference numbers can be obtained through the usqa|^ERIC j 
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^ Copi&$ majrbe^optaiQi^ from: - ^ 

' * STATE EDUCATIONAL ACGOUNTABILITY REPOSITORY 
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